AMD EPYC chips now handle every step of agentic AI workflows

Credit: AMD · newsroom.amd.com

Advanced Micro Devices is staking a claim at the heart of increasingly complex artificial intelligence workflows. The AMD EPYC 9006 Series server CPU is positioned as a core component for “agentic AI” systems, where multiple CPU roles are combined into a single workflow, alongside cloud, enterprise, and high-performance computing. This focus extends beyond simply powering AI models; AMD aims to support the orchestration of AI tasks themselves. The company reinforces this position with strict licensing terms, granting permission to use its trademarks only on products that “include an AMD CPU, GPU, APU, or FPGA.”

AMD EPYC 9006 Series Powers Agentic AI Workflows

The 6th Generation AMD EPYC 9006 “Venice” series processors now accommodate diverse roles within agentic AI pipelines without necessitating separate operating environments, a capability AMD highlights in a newly published white paper evaluating the CPUs across multiple workload types. This flexibility stems from a design philosophy prioritizing adaptability, recognizing that agentic AI systems inherently combine disparate computational tasks into a single workflow. Enterprises, already accustomed to tailoring system profiles for databases, virtualization, and AI, will find this approach familiar, yet expanded to encompass a broader range of demands.

Published benchmarks demonstrate a performance advantage for the AMD EPYC 9996 processor compared to both NVIDIA Vera and Intel Xeon 6980P in single-processor configurations, measured by estimated scores and per-core performance, the company says. Specifically, the 96-core EPYC 9996 achieved a score of 1210, translating to 6.3 per core, while the 88-core NVIDIA Vera scored 729.5, yielding 8.29 per core.

Compared to the 128-core Intel Xeon 6980P, performance comparisons are detailed in “AMD EPYC Server CPU Architecture and Performance Overview.” AMD further detailed specific configurations used in testing, including systems equipped with either 32x 64 GiB RDIMMs or MRDIMMs of DDR5 memory, operating at speeds up to 12800 MT/s, paired with Red Hat Enterprise Linux 10.1. Two-processor configurations utilized 256 cores per socket, totaling 512 cores with SMT disabled, ensuring a one-thread-per-core workload.

These rigorous testing parameters, as outlined in the white paper, aim to provide a comprehensive assessment of the EPYC 9006 series’ capabilities in demanding agentic AI scenarios. “Building Infrastructure for an AI World in Motion” further details the company’s vision for supporting these evolving workflows. The company’s approach extends beyond raw processing power, with a clear emphasis on maintaining control over its brand identity.

Trademark and copyright protections are protected under relevant trademark and copyright laws around the world, and are provided on an “as is” basis, according to AMD. Major OEM platforms are on track to launch, and leading cloud providers will begin deploying the EPYC 9006 series later this year, solidifying its position within the agentic AI ecosystem. Across enterprise and cloud-native testing, including server-side Java, OpenSSL, MongoDB, Redis, NGINX and transaction processing, AMD testing reports gains of 2.4x to 3.7x.

Agentic AI Drives Demand for CPU Flexibility

The AMD EPYC 9996 server CPU delivers 1.2 times the per-core performance of an Nvidia Vera-based platform in SPECrate 2026 Integer testing, a metric increasingly vital as artificial intelligence tasks fragment into complex, multi-step processes. This performance advantage isn’t isolated to raw speed; AMD’s latest processors are designed to accommodate the shifting demands of “agentic AI,” where a single user request can trigger a dynamic chain of operations requiring diverse compute resources.

Enterprises are already recognizing this need for adaptable infrastructure, moving beyond simply optimizing for training or inference to supporting a pipeline where tasks like retrieval, tool calls, and code execution occur in sequence, altering computational needs with each step. A key shift in infrastructure planning is underway, moving away from designs fixed to a single point in time and toward systems built for continuous adaptation.

Flexibility is no longer a desirable feature, but a fundamental requirement across the entire computational stack, including the CPUs that underpin agentic workflows. AMD responds to this demand with a portfolio approach, evaluating the 6th Generation EPYC 9006 “Venice” CPUs across a broad spectrum of workloads, general-purpose, enterprise, cloud-native, AI, and high-performance computing, rather than focusing on a limited set of benchmarks. This detailed assessment, outlined in a new AMD white paper, highlights the processor’s ability to handle the varied demands of modern AI systems.

Compared to the Intel Xeon 6980P processor, the EPYC 9996 delivers performance advantages of 1.8x to 3.13x in demanding applications like molecular dynamics, materials modeling, and weather forecasting, according to the company. In a modeled 100-kilowatt rack, the AMD processor delivers an estimated 3.4 times the throughput of a Vera-based platform, demonstrating its efficiency in high-density deployments, the company says. Strong per-core performance accelerates latency-sensitive tasks, while high core density supports concurrency and improves overall rack-level throughput.

“Venice” is not an isolated product, but one component of a broader strategy. AMD offers four processor families running on a common software foundation, ranging from 8-core edge deployments to 256-core flagship processors and rack-scale AI host nodes.

This allows customers to tailor the processor profile to each role within an agentic pipeline, avoiding the need for separate operating environments and simplifying system management. According to AMD documentation, “Each role in an agentic pipeline can use the processor profile that fits it without creating a separate operating environment.” The company’s commitment to this approach is reinforced by the fact that “Venice” is currently in production, with major OEM platforms slated to launch soon and leading cloud providers beginning deployments later this year.

Agentic AI is expected to further diversify workload demands, and AMD argues that the answer to this increasing complexity is not less choice, but more. The company’s portfolio strategy aims to provide the right processor for every task, optimizing performance and efficiency across the entire AI stack.

EPYC 9006 “Venice” Performance in SPECrate 2026 Integer Testing

The AMD EPYC 9996 server CPU achieved a SPECrate2026intbase score of 1210 in internal testing, representing 6.3 performance per core, according to AMD estimates from July 22, 2026. This benchmark, focused on integer processing, demonstrates gains across a range of enterprise and cloud-native workloads including Java, OpenSSL, MongoDB, Redis, and NGINX, with reported performance improvements ranging from 2.4x to 3.7x. These results position the EPYC 9996 as a key component in systems designed to handle increasingly complex computational demands.

Beyond general-purpose server tasks, AMD’s testing reveals significant advantages in specialized applications, with the EPYC 9996 outperforming the Intel Xeon 6980P processor by a margin of 1, the company states. Specifically, a single-processor AMD EPYC 9996 configuration delivered up to 3.5x the MongoDB throughput of a comparable Intel Xeon 6980P system, as measured on July 20, 2026, using the KVM virtualization platform and Ubuntu 24.04.

Similarly, in cryptographic workloads utilizing OpenSSL, the EPYC 9996 demonstrated up to 2.5x the throughput of the Intel processor under identical conditions. These gains are attributed to the EPYC 9996’s core count and architecture, optimized for handling parallel processing tasks common in these scientific and data-intensive applications. Configurations used for these tests included 6th Generation AMD EPYC processors with either 96 or 128 cores, utilizing AOCC 5.1 and 16x64GB 4R MRDIMM 12800 MT/s memory, while Intel Xeon 6980P systems employed OneAPI with 12x64GB MRDIMM 8800 MT/s, by the company’s account.

AMD also compared its processor against an Arm AGI system using GCC 13 and 12x64GB MRDIMM 8800 MT/s, further highlighting the performance characteristics of its EPYC series. The company’s commitment to open-source tools is evident in its use of GCC and OpenMPI for benchmarking, alongside its own AOCC compiler suite.

The GROMACS (benchPEP) performance comparison, conducted on July 15, 2026, showed that the AMD EPYC 9996, in a dual-processor configuration, outperformed the Intel Xeon 6980P in molecular dynamics simulations, the company claims. The AMD system utilized AOCC 5.1 with AOCL 5.1 and OpenMPI 4.5, while the Intel system employed Intel compiler 2023.0.0 with MKL 2023.0 and OpenMPI 4.5, the company says.

These results, derived from the mean of three runs, underscore the EPYC processor’s capabilities in handling computationally demanding scientific workloads. As AMD expands its portfolio of processors, it continues to emphasize performance gains across a diverse range of applications, positioning its EPYC series as a versatile solution for modern computing needs.

AMD EPYC Advantages Across Enterprise and Cloud Workloads

The AMD EPYC 9996 server CPU achieves 1.2 times the per-core performance of an Nvidia Vera-based platform and 2.24 times its platform-level performance. AMD’s focus on optimizing for diverse roles within agentic AI workflows addresses a growing need for adaptable infrastructure, as enterprises increasingly demand systems capable of handling varied computational demands.

This comprehensive approach reflects an understanding that agentic AI, unlike traditional AI models, requires a dynamic interplay of different processing needs, necessitating a CPU capable of excelling across the entire stack. It is a requirement at every layer of the stack, including the CPUs supporting the agentic pipeline,” underscoring the importance of adaptable hardware in this emerging field.

Beyond cloud and enterprise applications, the AMD EPYC 9996 also demonstrates significant performance improvements in computationally intensive scientific workloads. Testing configurations utilized 2P systems with either 256 cores per socket, and up to 2048 GiB of DDR5 memory operating at speeds of 8000 MT/s or 12800 MT/s with MRDIMM technology, showcasing the processor’s ability to utilize high-bandwidth memory for demanding applications. AMD’s partnerships, including collaborations with IBM Quantum and Quantinuum, further demonstrate its commitment to providing high-performance computing infrastructure for complex scientific endeavors, according to Intel.

AMD’s position as a provider of both classical processors and infrastructure for quantum computing, as evidenced by its work with Xanadu and its 2026 release of the MI350P AI card, positions the company uniquely to support hybrid computing models. The MI350P, featuring 144GB of HBM3E memory, rivals the Nvidia H200 in compute speed, and the Alveo accelerators can boost quantum simulation performance by up to 30x. This broader portfolio, coupled with partnerships like the one with TD SYNNEX to prepare AMD EPYC environments for post-quantum security, demonstrates a long-term vision for secure and scalable computing solutions.

EPYC 9996 Outperforms Intel in HPC Modeling and Simulation

In SPECrate 2026 Integer testing, a single-processor AMD EPYC 9996 achieved 6.3 performance per core, exceeding the performance of an Nvidia Vera-based platform. The company’s testing methodology involved averaging results from three runs to ensure statistical reliability, the company says. This broad applicability suggests the EPYC 9996 is well-suited for diverse server environments and demanding cloud workloads, offering significant acceleration across key software stacks.

AMD EPYC processors currently power quantum control computers at IBM Quantum, Rigetti, and IQM data centers, demonstrating its commitment to supporting the evolving landscape of hybrid quantum-classical computing. This dual focus allows AMD to address the growing demand for high-performance computing across a wide range of scientific and industrial applications, from materials science to drug discovery.

Stay current

See today’s quantum computing news on Quantum Zeitgeist for the latest breakthroughs in qubits, hardware, algorithms, and industry deals.

Avatar of Dr. Donovan

Latest Posts by Dr. Donovan: