Microsoft Pushes Custom AI Chips with Azure Maia 300 - Data Center Knowledge

AI & Compute

Microsoft Pushes Custom AI Silicon with Azure Maia 300

Microsoft is advancing its second-generation custom AI accelerator, the Azure Maia 300, for Azure data center workloads, per Data Center Knowledge. The chip targets inference and training at hyperscale.

By
Tom Whitfield
Filed
Channel
AI & Compute
Read
4 min read

Microsoft is moving forward with its second-generation in-house AI accelerator, branded Azure Maia 300, according to a headline published by Data Center Knowledge. The chip is positioned to handle generative AI inference and training inside Microsoft's Azure data centers, continuing a custom-silicon effort that began with the Azure Maia 100 announcement in November 2023.

Why does Microsoft need its own AI silicon?

The cloud operator has spent the past two years building an internal chip organization under Rani Borkar, the corporate vice president who leads Microsoft's hardware engineering for Azure. The strategic logic is straightforward. Hyperscale AI demand has stressed supply of third-party accelerators, and the cost of inference at scale has become a line item that Microsoft can no longer absorb passively.

By designing its own accelerator, Microsoft gains three levers that an off-the-shelf GPU cannot provide. It can tune the silicon for the specific transformer models that dominate its Azure OpenAI service. It can co-design the host CPU, memory subsystem, and rack-level networking around the accelerator. And it can amortize engineering cost across the largest AI workload base in commercial cloud.

The Maia family is the practical expression of that strategy.

Where does the Maia 300 sit in the lineup?

Microsoft has not publicly released detailed specifications for the Maia 300. The naming convention, however, places the part as a successor to the Maia 100, which Microsoft disclosed alongside the Cobalt 100 server CPU at its Ignite conference in late 2023. The Maia 100 was fabricated on TSMC's N5 process and integrated into Microsoft-designed server boards and rack chassis.

Key facts that can be stated without speculation:

  • The Maia 300 is a Microsoft-designed AI accelerator intended for Azure data center deployment.
  • It is the reported successor to the Azure Maia 100, Microsoft's first-generation AI chip.
  • Microsoft's custom silicon program is led by Rani Borkar's Azure hardware organization.
  • The custom chip work runs in parallel with Microsoft's continued large-scale purchases of Nvidia H100 and H200 GPUs for Azure.

What changes for Nvidia and AMD?

The commercial impact depends on volume. Nvidia reported data center revenue of $47.5 billion in fiscal 2025, a figure that includes purchases by Microsoft, Google, Meta, and the major hyperscalers. Microsoft's own design work does not displace that pipeline in the short term. The H100 and the Blackwell-generation B200 remain the default training silicon for frontier model builders.

Where Microsoft can move the needle is on inference. Inference workloads are steady-state, latency-sensitive, and run continuously. They reward silicon that is tuned for a specific model family rather than raw training throughput. A purpose-built inference accelerator with a competitive cost-per-token figure can displace a portion of Nvidia's volume inside a single hyperscaler's fleet without affecting the broader market.

Microsoft's posture is consistent with that calculus. The company has publicly described its custom silicon as complementary to Nvidia, not competitive with it at the high end of training.

How does this fit the broader custom-chip trend?

Microsoft joins Google, Amazon, and Meta in operating an in-house AI accelerator program. Google's TPU has been in production since 2018 and now spans multiple generations, with the Trillium generation shipping in 2024. Amazon's Trainium and Inferentia lines target training and inference inside AWS. Meta's MTIA family focuses on recommendation and ranking workloads.

The four largest hyperscalers are now also the four largest merchant buyers of third-party AI accelerators. That overlap is the central tension in the segment. Custom silicon reduces cost and improves workload fit. Off-the-shelf silicon offers supply elasticity and a mature software stack.

What to watch next

The operative question for the second half of 2026 is deployment volume. Microsoft has not disclosed how many Maia 300 units it intends to ship, nor which foundry node the part targets. Until those figures are published, the chip's commercial weight inside Azure remains a roadmap rather than a confirmed capacity figure. Pricing-per-token for inference on Maia 300 versus Nvidia B200 will be the metric that determines whether Microsoft's second custom accelerator scales beyond pilot racks and into the broader Azure fleet.

Source: Google News: AI chips

Share this article:

More from Tom Whitfield

Tom Whitfield

Show full bio

Staff writer covering companies, deals and strategy in Semiconductors, chip manufacturing, hardware, AI compute at Chip Dispatch.

456 articles

Related articles

« Previous articleNext article »