Microsoft Takes On Nvidia With Its Own Powerful AI Chips - www.cheddar.com

AI & Compute

Microsoft Reportedly Develops Custom AI Silicon to Challenge Nvidia

Microsoft is developing custom AI accelerators to challenge Nvidia, according to a Cheddar report. The move would place the software giant alongside Google and Amazon, which have already deployed proprietary AI chips in their data centers.

By
Rebecca Stone
Filed
Channel
AI & Compute
Read
3 min read

Microsoft is developing custom artificial intelligence accelerators in a direct bid to reduce dependence on Nvidia, according to a Cheddar report. The effort would place the Redmond, Washington-based software and cloud company alongside Google and Amazon, both of which have already deployed proprietary AI chips in their data centers.

The Cheddar report, headlined "Microsoft Takes On Nvidia With Its Own Powerful AI Chips," provides no specifics on chip architecture, manufacturing partner, process node, or deployment timeline. The lack of technical detail leaves significant questions about how Microsoft's silicon will compare with Nvidia's GPUs, which currently dominate AI training and inference.

What does Microsoft gain from custom silicon?

The strategic logic is clear in industry context. Hyperscale cloud operators have spent the past several years designing custom accelerators to optimize performance for specific workloads, control supply chains, and capture margin that currently flows to Nvidia. Google introduced its Tensor Processing Unit in 2016 and has since iterated through multiple generations. Amazon Web Services offers Trainium for training and Inferentia for inference.

For Microsoft, custom silicon would address a specific vulnerability. The company has been one of Nvidia's largest customers, deploying accelerators at scale to train large language models that power products including its Copilot assistant and the Azure OpenAI Service. Continued reliance on a single supplier creates supply risk, pricing pressure, and limits Microsoft's ability to differentiate Azure against competitors running similar Nvidia-based infrastructure.

How does this affect Nvidia's position?

The competitive implications for Nvidia are nuanced. Microsoft, Amazon, and Google have the engineering depth and capital to design competitive accelerators, and they consume enough AI compute annually to justify multi-year, multi-billion-dollar silicon programs. However, Nvidia's CUDA software ecosystem remains a powerful moat. Developers and machine learning researchers have spent years building tools, libraries, and frameworks optimized for Nvidia hardware.

Smaller cloud providers and enterprises are likely to remain Nvidia customers regardless. The economics of custom chip design only work for organizations with sufficient scale, and even the largest hyperscalers will continue purchasing Nvidia GPUs for workloads where they offer the best performance or where software compatibility is essential.

What technical questions remain unanswered?

The Cheddar report did not specify whether Microsoft's chips will target training, inference, or both workloads. AI training and inference impose different requirements on silicon: training demands high-bandwidth memory and fast interconnects to move large datasets across thousands of accelerators, while inference prioritizes throughput-per-watt and latency. The choice will shape Microsoft's competitive positioning.

How quickly Microsoft can bring competitive chips to market remains the central question. Designing and validating a new AI accelerator typically requires several years of engineering work, foundry capacity allocation, and software ecosystem development. Until Microsoft discloses more about its silicon roadmap, the precise threat to Nvidia's market position will remain difficult to assess.

The development comes as the AI infrastructure market continues to expand rapidly, with enterprises across industries deploying generative AI systems that require massive computational resources. Demand for accelerators has consistently outpaced supply, creating allocation challenges for cloud providers and pushing prices higher. Custom silicon offers one path to relieve those constraints while reducing per-query costs.

Source: Google News: AI chips

Share this article:

More from Rebecca Stone

Rebecca Stone

Show full bio

Correspondent covering technology and product news in Semiconductors, chip manufacturing, hardware, AI compute at Chip Dispatch.

300 articles

Related articles

« Previous articleNext article »