AI cluster technology drives scalable performance [Video]

Artificial intelligence is undergoing a major transformation as AI cluster technology advances, revolutionizing how industries integrate and implement this powerful tool.

This emerging technology is not only speeding up AI processes but also making them more efficient and cost-effective, driving broader adoption and accessibility across various sectors, said David Kanter (pictured, middle), founder and head of MLPerf at MLCommons Association.

“One of the things that I’m excited about that the team has done recently is first of all, we’ve added a lot of gen AI benchmarks,” Kanter said. “Then we also added power measurement so that you can see whether it’s data center inference or training of these large-scale models, how much power and energy are you using? And we’ve seen in the five years that we’ve been around, we were able to get something like 50 times better performance, which is way faster than what we would expect.”

Kanter and Adi Gangidi(right), RDMA systems for AI training at Meta …