Google Cloud upgrades AI infrastructure with Trillium TPU and Nvidia-powered VMs [Video]

In brief: By integrating custom-designed hardware like Trillium with industry-leading GPUs from Nvidia, Google Cloud is positioning itself as contender in the rapidly evolving field of AI computing. Its latest advancements promise to accelerate developing and deploying sophisticated AI models and applications across diverse industries.

Google Cloud recently announced a major upgrade to its AI infrastructure, introducing new hardware and software solutions designed to meet the growing demands of artificial intelligence workloads. The centerpiece of these changes is the release of Trillium, Google’s sixth-generation Tensor Processing Unit (TPU).

Compared to its predecessor, the TPU v5e, Trillium delivers over four times the training performance and up to three times the inference throughput. This improvement is accompanied by a 67% increase in energy efficiency.

The new TPU boasts impressive specifications, including double the High Bandwidth Memory (HBM) capacity and Interchip Interconnect …