Between sustainability and risk: why CIOs are considering small language models [Video]

Gen AI has undeniable promises, but LLMs may not be the way to apply it in the enterprise. On the horizon are less energy-intensive smaller models based on specific data that allow IT to maintain control.

Credit: Gorodenkoff / Shutterstock

As GPT-4 passes the Turing test, Microsoft pushes its AI assistant Copilot into enterprise products, and as Google announces the availability of the Gemini app on mobile phones in Italy, CIOs are studying gen AI technology to stay up-to-date — but without being distracted by either technological excitement or commercial propositions.

“Generative AI can bring many benefits, but it can’t be adopted without appropriate considerations,” says Massimo Carboni, CTO and head of the infrastructure department at GARR, the broadband network dedicated to the Italianresearch and education community. “The hype is very strong, but the risk of overestimating its possibilities is equally high. In the digital world, we must be increasingly careful, and the first risk with AI and …