Microsoft makes ‘biggest bet yet’ on its own silicon, unveils new AI chip to reduce reliance on Nvidia - GeekWire

AI & Compute

Microsoft's New AI Chip Marks Its Largest Silicon Bet Yet

Microsoft has unveiled a new AI accelerator that the company describes as its largest investment yet in proprietary silicon, a move aimed at trimming reliance on Nvidia's data-center GPUs and easing supply pressure on H100 and B200 allocations.

By
Nathan Brooks
Filed
Channel
AI & Compute
Read
4 min read

Microsoft has unveiled a new artificial-intelligence accelerator that the company describes as its largest investment yet in proprietary silicon, a step aimed at trimming its reliance on Nvidia's data-center GPUs.

According to GeekWire's reporting, Microsoft framed the chip as its "biggest bet yet" on custom hardware. The company has not yet disclosed a formal name, process node, or production volume for the part. The strategic intent, however, requires little decoding: every hyperscaler buying Nvidia silicon at scale is now building an alternative.

What has Microsoft tried before?

Microsoft's custom-silicon program is not new. The company introduced its first Azure Maia AI accelerator in late 2023, alongside an Arm-based server CPU codenamed Cobalt. Both parts ran on Taiwan Semiconductor Manufacturing Co.'s 5-nanometer process. Their role was workhorse rather than flagship, handling inference for Copilot services and selected training jobs.

The new chip, by any reading, raises the program's profile.

Why move now?

The arithmetic explains the urgency. Nvidia's data-center revenue has compounded faster than any segment in semiconductor history, and gross margins have remained above 70 percent. The pricing power sits with the supplier. Hyperscalers running AI workloads at scale absorb that premium every quarter, and the supply allocation for H100, H200, and B200 silicon remains the binding constraint on cloud growth.

Custom silicon offers three benefits:

  • Lower unit cost once volumes scale past the design-recovery threshold
  • Supply independence when merchant allocations tighten
  • Tight co-design with internal model workloads, which a general-purpose merchant chip cannot match

Each benefit is rational. None of them is automatic.

What is the broader cohort doing?

Microsoft joins a peer group that has spent half a decade on similar bets:

  • Google has shipped Tensor Processing Units since 2018 and now runs TPU v5p in production
  • Amazon Web Services offers Trainium2 for training and Inferentia2 for inference
  • Meta has deployed MTIA chips across its recommendation and ranking workloads

The collective signal is unambiguous. The largest cloud operators no longer accept a single-vendor stack for their most expensive workloads.

What changes for Nvidia?

Nvidia's near-term position remains secure. Its installed base, its CUDA software stack, and a roadmap cadence running ahead of merchant alternatives form a moat no hyperscaler has yet breached. Microsoft will still buy Nvidia silicon; the new chip runs alongside it rather than replacing it.

The contest is at the margin. If Microsoft diverts a meaningful slice of training traffic onto first-party hardware, the demand pressure on H200 and B100 allocations eases. Pricing for the rest of the market softens with it. That is a slow squeeze rather than a sudden rupture, and Nvidia's earnings will show the second-order cost before any revenue loss.

What about TSMC?

Taiwan Semiconductor Manufacturing Co. retains the contract. Every hyperscaler accelerator in production today passes through TSMC's leading-edge fabs, typically on the 3-nanometer or 5-nanometer node. If Microsoft's new part lands on N3 or below, it adds incremental wafer demand at the industry's tightest capacity point. Nvidia's relative share of TSMC's leading-edge output narrows even as the foundry's total addressable demand widens.

What are the limits?

Hardware is the easier half of the problem. The harder half is software. Nvidia's CUDA developer ecosystem, plus TensorRT and the broader library stack, creates switching costs that no first-party chip can override on its own. Microsoft will need to support a parallel toolchain, port the largest models, and convince application teams that the trade is worth the effort. The graveyard of custom accelerators contains parts that underperformed on benchmarks and quietly disappeared from roadmaps.

Microsoft's deeper resources and its OpenAI relationship give it a better starting position than most. That still leaves the execution gap, which is where custom-silicon programs succeed or fail.

A close observer might note the structural irony. Nvidia built its fortune selling the picks and shovels of the AI gold rush. The largest prospectors now dig their own mines. The result is a market in which Nvidia keeps the high ground while the lower flanks open to competition, a configuration that will define data-center silicon economics for the rest of the decade.

Source: Google News: AI chips

Share this article:

More from Nathan Brooks

Nathan Brooks

Show full bio

Senior reporter covering people, launches and day-to-day practice in Semiconductors, chip manufacturing, hardware, AI compute at Chip Dispatch.

359 articles

Related articles

« Previous articleNext article »