Getting infrastructure right for generative AI

June 3, 2024

Via: CIO

Ensuring a cost-effective approach for delivering the massive storage, bandwidth, and computing resources necessary for genAI is no easy task. Here’s how innovative IT leaders are coping.

Facts, it has been said, are stubborn things. For generative AI, a stubborn fact is that it consumes very large quantities of compute cycles, data storage, network bandwidth, electrical power, and air conditioning. As CIOs respond to corporate mandates to “just do something” with genAI, many are launching cloud-based or on-premises initiatives. But while the payback promised by many genAI projects is nebulous, the costs of the infrastructure to run them is finite, and too often, unacceptably high.

Read More on CIO