Infrastructure advancements reshaping the AI and data landscape [Video]

Infrastructure advancements are changing numerous arenas, more specifically, the integration of artificial intelligence infrastructure and memory technology, which, in turn, is reshaping the data landscape.

The discussions at HPE Discover 2024 highlighted the industry’s relentless pursuit to overcome the memory wall, a challenge arising from the imbalance between CPU/GPU capabilities and memory performance. These developments are crucial in supporting the burgeoning demands of AI and large language models, paving the way for more efficient and powerful computing solutions, according to Alan Walker (pictured, right), senior director of sales at Samsung Semiconductor Inc.

“When we think about the traditional memory pyramid with the cache memory at the top, and then your system memory storage underneath, that pyramid is now growing several layers and becoming a much larger pyramid,” Walker said. “At the top, we have high bandwidth memory…under the memory itself, we’re now adding additional capabilities…and then even under that, you now have multiple different types of …