Microsoft uses MI300X for some inference workloads. I felt like 1.6% on AMD was too low given that they clearly had some interest in using AMD GPUs.

[Microsoft’s] new Maia 100 AI Accelerator will power some of the largest internal AI workloads running on Microsoft Azure. Additionally, OpenAI has provided feedback on Azure Maia and Microsoft’s deep insights into how OpenAI’s workloads run oninfrastructure tailored for its large language models is helping inform future Microsoft designs.

“Since first partnering with Microsoft, we’ve collaborated to co-design Azure’s AI infrastructure at every layer for our models and unprecedented training needs,” said Sam Altman, CEO of OpenAI. “We were excited when Microsoft first shared their designs for the Maia chip, and we’ve worked together to refine and test it with our models. Azure’s end-to-end AI architecture, now optimized down to the silicon with Maia, paves the way for training more capable models and making those models cheaper for our customers.”

-Microsoft press release, Nov 2023

Next gen model experiments will begin this year (h100) and start moving in earnest next year with blackwell (b100) architecture.

Should probably add Google, since they have the TPU line

@SaviorofPlant I thought it was unlikely since Google Gemini directly competes with ChatGPT, but ok I have added it