Meta Deploys Tens of Millions of AWS Graviton AI Cores

Meta is deploying tens of millions of AWS Graviton cores, signaling a significant investment in CPU infrastructure that extends beyond typical server expansions and reveals the scale of the company’s ambitions for artificial intelligence. This expansion of a long-standing partnership with Amazon Web Services reflects a growing demand for CPU-intensive workloads driven by the rise of “agentic AI”, systems designed to actively perform tasks like reasoning, code generation, and complex task orchestration. While GPUs remain vital for training large models, Meta is prioritizing AI that moves beyond prediction to real-world action, and Graviton5 is purpose-built for these demands. The chips will power various workloads at Meta, supporting infrastructure capable of handling billions of interactions and coordinating complex AI workflows.

Meta Scales AI Infrastructure with AWS Graviton Processors

Tens of millions of Graviton cores will initially form the foundation of Meta’s expanded AI infrastructure, representing a substantial investment beyond typical server upgrades and signaling the breadth of their artificial intelligence objectives. This agreement with AWS signifies a strategic shift; while graphics processing units remain crucial for training expansive models, the emergence of “agentic AI” is driving demand for CPU-intensive tasks like real-time reasoning and complex workflow orchestration. Graviton5 processors were specifically chosen for their suitability to these agentic AI workloads, providing Meta with the processing capacity to operate them efficiently at scale; the company requires systems that can coordinate intricate, multi-step agent workflows, a task for which Graviton is designed. This move demonstrates a focus on AI systems that perform tasks, such as generating code and orchestrating tasks, rather than solely predicting outcomes. The partnership builds on a long-standing relationship between Meta and AWS, and offers the flexibility to expand capacity as Meta’s AI capabilities continue to evolve, ensuring the company can meet the demands of increasingly sophisticated AI applications.

Agentic AI Drives Demand for CPU-Intensive Workloads

Graviton processors are specifically designed to handle these evolving workloads, providing Meta with the computational power needed to efficiently manage billions of interactions and coordinate intricate agent workflows. This focus on agentic AI suggests a strategic direction beyond large language models, towards systems capable of autonomous action and problem-solving. The scale of this deployment underscores a growing recognition that effective AI requires a balance between the parallel processing strengths of GPUs and the sequential, reasoning capabilities of CPUs, positioning Meta to capitalize on the next wave of AI innovation.

By democratizing technology for nearly two decades and making cloud computing and generative AI accessible to organizations of every size and industry, AWS has built one of the fastest-growing enterprise technology businesses in history.

Amazon Web Services (AWS)
Ivy Delaney

Ivy Delaney

We've seen the rise of AI over the last few short years with the rise of the LLM and companies such as Open AI with its ChatGPT service. Ivy has been working with Neural Networks, Machine Learning and AI since the mid nineties and talk about the latest exciting developments in the field.

Latest Posts by Ivy Delaney: