Meta Deploys Tens of Millions of AWS Graviton AI Cores

Meta is deploying tens of millions of AWS Graviton cores, signaling a significant investment in CPU infrastructure that extends beyond typical server expansions and reveals the scale of the company’s ambitions for artificial intelligence. This expansion of a long-standing partnership with Amazon Web Services reflects a growing demand for CPU-intensive workloads driven by the rise of “agentic AI”, systems designed to actively perform tasks like reasoning, code generation, and complex task orchestration. While GPUs remain vital for training large models, Meta is prioritizing AI that moves beyond prediction to real-world action, and Graviton5 is purpose-built for these demands. The chips will power various workloads at Meta, supporting infrastructure capable of handling billions of interactions and coordinating complex AI workflows.

Meta Scales AI Infrastructure with AWS Graviton Processors

Tens of millions of Graviton cores will initially form the foundation of Meta’s expanded AI infrastructure, representing a substantial investment beyond typical server upgrades and signaling the breadth of their artificial intelligence objectives. This agreement with AWS signifies a strategic shift; while graphics processing units remain crucial for training expansive models, the emergence of “agentic AI” is driving demand for CPU-intensive tasks like real-time reasoning and complex workflow orchestration. Graviton5 processors were specifically chosen for their suitability to these agentic AI workloads, providing Meta with the processing capacity to operate them efficiently at scale; the company requires systems that can coordinate intricate, multi-step agent workflows, a task for which Graviton is designed. This move demonstrates a focus on AI systems that perform tasks, such as generating code and orchestrating tasks, rather than solely predicting outcomes. The partnership builds on a long-standing relationship between Meta and AWS, and offers the flexibility to expand capacity as Meta’s AI capabilities continue to evolve, ensuring the company can meet the demands of increasingly sophisticated AI applications.

Agentic AI Drives Demand for CPU-Intensive Workloads

Graviton processors are specifically designed to handle these evolving workloads, providing Meta with the computational power needed to efficiently manage billions of interactions and coordinate intricate agent workflows. This focus on agentic AI suggests a strategic direction beyond large language models, towards systems capable of autonomous action and problem-solving. The scale of this deployment underscores a growing recognition that effective AI requires a balance between the parallel processing strengths of GPUs and the sequential, reasoning capabilities of CPUs, positioning Meta to capitalize on the next wave of AI innovation.

By democratizing technology for nearly two decades and making cloud computing and generative AI accessible to organizations of every size and industry, AWS has built one of the fastest-growing enterprise technology businesses in history.

Amazon Web Services (AWS)
Stay current

See today’s quantum computing news on Quantum Zeitgeist for the latest breakthroughs in qubits, hardware, algorithms, and industry deals.

Avatar of Ivy Delaney

Ivy Delaney

Ivy Delaney has been working with neural networks and machine learning since the mid-nineties, back when a couple of hidden layers and a long afternoon of training counted as ambitious. She has watched the field go from academic curiosity to the thing quietly running underneath everything, and she brings that long view to quantum computing. For Quantum Zeitgeist she covers the ground where the two fields meet. That means quantum machine learning and the variational algorithms it leans on, and it also means the less glamorous but more interesting story of classical machine learning already doing real work inside quantum machines, decoding error-correcting codes, calibrating noisy hardware and learning the error models that simulators depend on. She writes about the hardware those algorithms have to run on too, and about the post-quantum cryptography scramble that the same hardware has set off. Her stories typically start with the paper, whether that is peer-reviewed work, conference proceedings or an arXiv preprint, with the source linked so you can hold a claim up against the research it came from. She is unimpressed by benchmarks that will not say what they beat, and by demonstrations that only work in the press release.

Latest Posts by Ivy Delaney: