High-performance AI chips: SambaNova’s Dataflow breakthrough [Video]

As artificial intelligence keeps gaining momentum, enterprises are increasingly focused on integrating large language models and private data capabilities. This growing demand makes high-performance AI chips more essential than ever.

AI hardware leader SambaNova Systems Inc. offers cutting-edge solutions, such as Reconfigurable Dataflow Architecture, that accelerate AI tasks through the dynamic maximization of computing resources, according to the company’s co-founder and chief executive officer, Rodrigo Liang (pictured). 

“10X performance of one-10th the power; that’s what we do,” Liang said. “People want to go to production, you want to run a Llama 400B model, which we just announced. We’re able to do that 115 tokens per second, which is 10 times faster than anybody else out there, and we run it at less than 19 kilowatt. We build everything from the architecture all the way down to the substrates and we use all of those technologies — it’s a Dataflow chip.”

Liang spoke with theCUBE Research’s …