NVIDIA Blackwell Boosts Open Compute AI

NVIDIA has made a significant contribution to the Open Compute Project, an open hardware ecosystem, by sharing its Blackwell platform design. This move is expected to accelerate innovation in artificial intelligence infrastructure. At the OCP Global Summit, NVIDIA announced that it will share key elements of its GB200 NVL72 system electro-mechanical design with the OCP community, including rack architecture and thermal environment specifications.

This contribution builds on NVIDIA’s previous contributions to OCP, including its HGX H100 baseboard design specification. Jensen Huang, founder and CEO of NVIDIA, emphasized the importance of advancing open standards to help organizations worldwide take advantage of accelerated computing and create AI factories of the future.

The Blackwell platform is designed to power a new era of AI, featuring 36 NVIDIA Grace CPUs and 72 NVIDIA Blackwell GPUs in a rack-scale design. Meta, a key partner, plans to contribute its Catalina AI rack architecture based on GB200 NVL72 to OCP, providing computer makers with flexible options to build high compute density systems.

Accelerating AI Infrastructure Innovation through Open Hardware Ecosystems

NVIDIA has made a significant contribution to the Open Compute Project (OCP) by sharing foundational elements of its NVIDIA Blackwell accelerated computing platform design. This move aims to drive the development of open, efficient, and scalable data center technologies. The company has also broadened its NVIDIA Spectrum-X support for OCP standards, enabling companies to unlock the performance potential of AI factories deploying OCP-recognized equipment while preserving their investments and maintaining software consistency.

The contribution includes key portions of the NVIDIA GB200 NVL72 system electro-mechanical design, such as rack architecture, compute and switch tray mechanicals, liquid-cooling and thermal environment specifications, and NVIDIA NVLink cable cartridge volumetrics. This will support higher compute density and networking bandwidth in data centers. NVIDIA has already made several official contributions to OCP across multiple hardware generations, including its NVIDIA HGX H100 baseboard design specification.

The open hardware ecosystem approach is crucial for driving innovation in AI infrastructure. By advancing open standards, organizations worldwide can take advantage of the full potential of accelerated computing and create the AI factories of the future. This collaboration between industry leaders will shape specifications and designs that can be widely adopted across the entire data center.

The NVIDIA Blackwell Accelerated Computing Platform

The NVIDIA Blackwell accelerated computing platform was designed to power a new era of AI. The GB200 NVL72 system is based on the NVIDIA MGX modular architecture, which enables computer makers to quickly and cost-effectively build a vast array of data center infrastructure designs. This liquid-cooled system connects 36 NVIDIA Grace CPUs and 72 NVIDIA Blackwell GPUs in a rack-scale design.

With a 72-GPU NVIDIA NVLink domain, it acts as a single, massive GPU and delivers 30x faster real-time trillion-parameter large language model inference than the NVIDIA H100 Tensor Core GPU. This platform is poised to revolutionize AI computing by providing unprecedented performance and scalability.

Critical Infrastructure for Data Centers

As the world transitions from general-purpose to accelerated and AI computing, data center infrastructure is becoming increasingly complex. To simplify the development process, NVIDIA is working closely with over 40 global electronics makers that provide key components to create AI factories. This collaboration will enable organizations to build highly flexible networks and meet the growing performance and energy efficiency needs of data centers.

Additionally, a broad array of partners are innovating and building on top of the Blackwell platform, including Meta, which plans to contribute its Catalina AI rack architecture based on GB200 NVL72 to OCP. This provides computer makers with flexible options to build high compute density systems and meet the growing demands of data centers.

The Role of Open Standards in Accelerating AI Innovation

The adoption of open standards is critical for accelerating AI innovation. By advancing open standards, organizations can take advantage of the full potential of accelerated computing and create the AI factories of the future. NVIDIA’s contributions to OCP will enable companies to unlock the performance potential of AI factories deploying OCP-recognized equipment while preserving their investments and maintaining software consistency.

The company’s Spectrum-X Ethernet networking platform, which now includes the next-generation NVIDIA ConnectX-8 SuperNIC, supports OCP’s Switch Abstraction Interface (SAI) and Software for Open Networking in the Cloud (SONiC) standards. This allows customers to use Spectrum-X’s adaptive routing and telemetry-based congestion control to accelerate Ethernet performance for scale-out AI workloads.

The availability of ConnectX-8 SuperNICs for OCP 3.0 next year will equip organizations to build highly flexible networks that can meet the growing demands of data centers. The collaboration between industry leaders, such as NVIDIA and Meta, will shape specifications and designs that can be widely adopted across the entire data center, driving innovation in AI infrastructure.

More information
External Link: Click Here For More
Stay current

See today’s quantum computing news on Quantum Zeitgeist for the latest breakthroughs in qubits, hardware, algorithms, and industry deals.

Avatar of Ivy Delaney

Ivy Delaney

Ivy Delaney has been working with neural networks and machine learning since the mid-nineties, back when a couple of hidden layers and a long afternoon of training counted as ambitious. She has watched the field go from academic curiosity to the thing quietly running underneath everything, and she brings that long view to quantum computing. For Quantum Zeitgeist she covers the ground where the two fields meet. That means quantum machine learning and the variational algorithms it leans on, and it also means the less glamorous but more interesting story of classical machine learning already doing real work inside quantum machines, decoding error-correcting codes, calibrating noisy hardware and learning the error models that simulators depend on. She writes about the hardware those algorithms have to run on too, and about the post-quantum cryptography scramble that the same hardware has set off. Her stories typically start with the paper, whether that is peer-reviewed work, conference proceedings or an arXiv preprint, with the source linked so you can hold a claim up against the research it came from. She is unimpressed by benchmarks that will not say what they beat, and by demonstrations that only work in the press release.

Latest Posts by Ivy Delaney: