AMD Makes NVIDIA GPUs EPYC [Video]

Even as competition soars between the two leading chip manufacturers, AMD and NVIDIA, a new partnership is quietly emerging between the two rivals in the AI and computing world. Few realise that AMD’s EPYC CPUs are critical in powering NVIDIA’s GPUs for large-scale AI workloads.

Case in point: As AI models grow in complexity, the demand for both GPU and CPU performance is increasing, with AMD CPUs showing significant potential to enhance NVIDIA’s GPUs.  

“We’ve shown a 20% improvement in training and 15% improvement in inference when connecting EPYC CPUs to NVIDIA’s H100 GPUs,” said Ravi Kuppuswamy, senior vice president & general manager at AMD.  At the Advancing AI 2024 event, Kuppuswamy cited the Llama 3.1 inference model with 8 H100 GPUs, where the CPU provided significant value in large-scale GPU clusters. 

He added that this is a joint collaboration between AMD and NVIDIA, where they have identified the best EPYC CPUsto optimise the configuration between …