CIOs expect extensive value from their artificial intelligence (AI) investments, including increased productivity, enhanced customer experience (CX) and digital transformation. As a result, Gartner client interest in deploying AI infrastructure – including graphics processing units (GPUs) and AI servers – has grown substantially.

Specifically, client enquiries regarding GPUs and AI infrastructure increased nearly fourfold annually from October 2022 through October 2024. Clients are exploring the use of hosted, cloud and on-premise-based options for GPU deployment. In some cases, enterprises will select a “full-stack” AI offering that includes GPU, compute, storage and networking in a bundled package. In other instances, enterprises will select and deploy the pieces, individually selected and integrated. The requirements of AI workloads are different from most existing datacentre workloads.