As AI scales, infrastructure challenges emerge [Video]

Early adopters of gen AI typically used ChatGPT, Microsoft Copilot, and similar SaaS tools that cost money but didn’t create infrastructure challenges. As companies scale up, however, those challenges are beginning to emerge.

Credit: insta_photos / Shutterstock

Organizations experimenting with gen AI typically set up enterprise-grade accounts with cloud-based services such as OpenAI’s ChatGPT or Anthropic’s Claude, and early field tests and productivity benefits may inspire them to look for more opportunities to deploy the technology.

“Companies use gen AI to produce executive summaries, or to produce marketing content,” says Nick Kramer, leader of applied solutions at SSA & Company, a global consulting firm, and next year, we’ll see increased adoption and standardization of these kinds of enterprise use cases, he says, as well as gen AI built into other applications that enterprises use. That’s where most of the value generation happens.

Adobe’s Photoshop, for example, now has a gen AI feature. Google and …