ASUS AI POD with 36 NVIDIA Grace CPUs and 72 Blackwell GPUs shipping in March [Video]

The ASUS AI POD, which features the NVIDIA GB200 NVL72 platform, has reached its latest milestone. Production is ramping up for a scheduled shipping date of March 2025. This thing is an absolute beast for AI performance and cutting-edge deep learning, as it’s built with the NVIDIA GB200 Grace Blackwell Superchip and fifth-generation NVIDIA NVLink interconnect technology.

When broken down, you’ve got 26 NVIDIA GRACE CPUs, 72 NVIDIA Blackwell Tensor Core GPUs, and 5th Gen NVIDIA NVLink Switches for low-latency communication with a capacity of 14.4 TB/s. Each of the 72 Blackwell GPUs includes two dies connected by a 10 terabytes per second (TB/s) chip-to-chip interconnect to offer 30X the LLM Inference of the NVIDIA H100 Tensor Core GPU and 4X the LLM Training performance of the H100.

The ASUS AI POD also supports liquid-to-air and liquid-to-liquid cooling, and it’s powerful enough to train a trillion-parameter language model and perform …