Ampere Computing's 192-Core Chip Won the Cloud's Power Bill

SoftBank's $6.5B acquisition bets that the future of AI inference runs on the Arm CPUs already inside Oracle and Google Cloud.

About Ampere Computing

Published

The first thing you notice is the silence. In a data center rack, the Ampere Altra chip draws less power than a lightbulb, a quiet counterpoint to the roar of the GPU clusters next door. It’s a chip designed for a specific kind of work: the relentless, parallelizable grind of serving web pages, running containers, and, increasingly, executing AI inference. While Nvidia commands the narrative on training giant models, Ampere spent seven years building the processor for everything that happens after the model is made, betting that efficiency would become the cloud’s most valuable currency [Wikipedia].

In March 2025, SoftBank Group Corp. validated that bet with a definitive move, agreeing to acquire Ampere Computing for $6.5 billion [SoftBank Group Corp. Press Release, March 2025]. The deal was for a company with silicon in production, powering virtual machines for Google Cloud, Oracle, and Microsoft Azure [SDxCentral]. The acquisition asks a straightforward question: in a world obsessed with raw AI horsepower, is there a more consequential throne to own than the one that serves the results, billions of times a day, at the lowest possible cost?

The cloud-first CPU

Ampere’s founding thesis was a rejection of general-purpose design. Instead of adapting legacy x86 architectures for the cloud, the company started from zero with Arm, building processors with one goal: maximum performance per watt for scale-out, cloud-native workloads [YouTube]. Its product line tells the story of that focus.

  • Ampere Altra. The entry point, with up to 80 cores, aimed at predictable performance for web servers and databases.
  • Altra Max. Scaled that to 128 cores, chasing higher density for containerized microservices.
  • AmpereOne. The current flagship, with up to 192 custom Arm-compatible cores per socket, built explicitly for high-throughput AI inference and other massively parallel tasks [Wikipedia][Ampere Computing].

A founder who saw the ceiling

The company’s trajectory is inseparable from its founder, Renée James. As a former president of Intel, she operated from the peak of the x86 empire, giving her a unique vantage point on its limitations for the cloud era [Wikipedia][The New York Times, 2015]. Her post-Intel role as an operating executive at The Carlyle Group provided the capital and strategic patience to spin Ampere out as a standalone entity [Wikipedia]. She recruited chip architects from the very fortresses she was besieging. CTO Atiq Bajwa is a 30-year Intel veteran who led x86 architecture; EVP of Engineering Rohit Vidwans spent 26 years at Intel; Senior Fellow Greg Favor is a former AMD and Arm lead architect [ZDNET].

The installed base

Technical specs are one thing. Customer logos are another. Ampere’s success is measured in cloud instances, the fundamental unit of the modern internet. Oracle Cloud Infrastructure launched Ampere A1 instances in 2021 and has since woven them into its managed Kubernetes and application services [Wikipedia]. Google Cloud offers Tau T2A virtual machines built on Ampere Altra [Wikipedia]. Microsoft has adopted the chips for Windows on Arm server workloads [Wikipedia]. Beyond the hyperscalers, the chips are in servers from HPE and Supermicro, and power infrastructure at Cloudflare and Equinix [SDxCentral].

Metric Value
2025 Acquisition by SoftBank $6,500M

The inference gambit

The SoftBank deal lands at a moment of transition. Public filings showed Ampere’s revenue declining from $46 million in 2023 to $16.5 million in 2024, a signal of the competitive pressure in the space. The core challenge is existential: can a CPU, even a supremely efficient one, hold its ground as AI inference workloads grow more complex and demanding?

Ampere’s answer is focus. It is not trying to be everything. It is betting that a significant portion of AI inference, particularly for large language models after the initial, computationally intense decoding steps, remains best served by a sea of efficient, deterministic cores. Its roadmap is designed to chase this “elastic architecture” deeper into the AI stack [Ampere Computing, 2026].

The next rack over

The real test for Ampere won’t be on a benchmark chart. It will be in the procurement meetings where cloud architects map out the next decade’s data center build. The question they are quietly answering is not “Which chip is fastest?” but “What is the cost of intelligence?” As AI moves from a research project to a utility, the economics of serving it will dictate its shape. Ampere’s entire existence is a bet that the most important number on the spreadsheet will shift from flops-per-second to inferences-per-watt.

Read on Startuply.vc