jain.com — data centers, connectivity and security, analyzed daily

Tag: Gartner

  • Gartner’s $23.3B Inference Forecast Shows AI Cloud Demand Turning Always-On

    Gartner’s $23.3B Inference Forecast Shows AI Cloud Demand Turning Always-On

    TL;DR · 30-second read

    The Short Version

    Businesses are on track to nearly double what they spend renting powerful computers for artificial intelligence this year, to about $42 billion, according to research firm Gartner.

    The bigger change is what that money pays for. For the first time, more will go to running artificial intelligence tools every day — answering customers, handling tasks at work — than to building new ones.

    Building happens in bursts. Running never stops. So the giant computer warehouses behind these tools increasingly have to stay busy, and powered, around the clock.

    Gartner said in a forecast published August 10, 2026 that worldwide spending on AI-optimized infrastructure as a service (IaaS) — rented cloud computing built for artificial intelligence workloads — will grow 96.4% in 2026 to $42.3 billion, up from $21.5 billion in 2025, and reach $66.1 billion in 2027, a further 56.5% increase.

    The research firm also forecast that in 2026 spending on inference (running trained AI models in production) will reach $23.3 billion and surpass spending on training (building those models) at $19 billion. Inference is projected to account for 55% of AI-optimized IaaS spending in 2026 and 59% in 2027.

    Executive Summary

    The headline number is the near-doubling of rented AI cloud spending, but the more consequential figure is the crossover: in Gartner’s forecast, 2026 is the year inference overtakes training as the larger use of AI-optimized cloud capacity. Hardeep Singh, Sr Principal Research Analyst at Gartner, attributes the shift to fine-tuned and domain-specific models being built into customer-facing and operational systems that require “continuous, real-time execution rather than periodic training.”

    That distinction matters for anyone who builds, powers or connects AI infrastructure. Training demand arrives as large, time-bound projects; inference demand scales with everyday usage and persists. A market increasingly weighted toward inference behaves less like a series of construction jobs and more like a utility load — steady, growing with adoption, and tied to where users and applications are.

    Gartner’s numbers also put the AI boom in proportion: AI-optimized services are forecast at 14.7% of total IaaS spending in 2026, and conventional cloud infrastructure keeps growing at roughly 20% a year alongside it. Data center operators face rising demand on both fronts, not a wholesale swap of one for the other.

    Inference Overtakes Training, and Demand Stops Arriving in Bursts

    Training is the process of building an AI model by feeding it vast amounts of data; inference is the work of using that finished model to answer a question, draft a document or complete a task. Gartner forecasts inference spending of $23.3 billion in 2026 against $19 billion for training, with inference’s share of AI-optimized IaaS rising from 55% in 2026 to 59% in 2027. Singh ties the shift to models moving into production systems that require “continuous, real-time execution rather than periodic training.”

    The mechanism is the shape of the demand. A training run is a project: a large block of accelerators — the specialized chips, usually GPUs, that do AI math — is reserved, runs for weeks, and is then released. Inference consumption instead scales with use: every customer query and every step an AI agent takes draws compute. Gartner specifically flags agentic AI, software that carries out multistep tasks on its own, as amplifying compute intensity. Demand that tracks usage behaves like a utility load — it persists, rises with adoption and follows the rhythm of the businesses it serves.

    That changes the planning problem for several groups. Cloud providers get fleets that are more consistently busy, which improves the economics of expensive accelerators. Data center operators and utilities see more load that draws close to its contracted power much of the time, rather than in project-driven peaks. And because inference feeding customer-facing systems has to reach those customers quickly, well-connected sites near users and networks tend to gain value relative to remote campuses chosen purely for cheap power.

    The Percentages Are Slowing. The Dollars Are Not.

    On growth rates alone, AI-optimized IaaS looks like it is cooling: 180% in 2025, 96.4% in 2026, 56.5% in 2027. But the absolute increments rise each year — about $20.7 billion of new annual spending in 2026 and roughly $23.9 billion in 2027. For people who build capacity, the increment is what counts: under Gartner’s forecast, each year requires more new AI-ready capacity than the year before, not less.

    The forecast also keeps AI in proportion. AI-optimized services are about 9.7% of total IaaS spending in 2025, 14.7% in 2026 and 18.4% in 2027. They account for roughly a third of the market’s growth in each forecast year. The remainder — general-purpose rented infrastructure — still grows by about 22% in 2026 and about 20% in 2027, on Gartner’s figures. AI is not crowding conventional cloud out of these numbers; builders face demand for both high-density AI halls and standard cloud capacity, which have very different power and cooling requirements.

    Rented AI Capacity Is Not the Same as Built Capacity

    Gartner’s figures measure what customers pay to rent AI-optimized infrastructure, not what cloud providers spend building it or what enterprises spend on hardware for their own facilities. The forecast therefore shows strong and rising demand for rented AI capacity, but on its own it cannot show AI investment shifting away from ownership toward the cloud, because it does not measure the ownership side.

    What it does indicate is where enterprise AI is being consumed as it moves into production. Singh says the shift toward deployment is “accelerating the cloud consumption patterns.” Rental spending is the revenue that providers weigh their construction against, and a forecast in which that revenue nearly doubles and tilts toward always-on inference strengthens the case for facilities designed for sustained, high-density load — heavier power delivery and the advanced cooling dense AI racks often require. The caveat is that this is a forecast: whether chips, power and finished data center space arrive fast enough to meet it is a separate question.

    Background

    Gartner, Inc. (NYSE: IT) is a Stamford, Connecticut-based research and advisory firm whose market spending forecasts are widely used by technology buyers, vendors and investors. Infrastructure as a service is the part of cloud computing in which customers rent raw computing, storage and networking from providers such as Amazon Web Services, Microsoft Azure and Google Cloud, paying for what they use instead of running their own hardware.

    The generative AI boom created a distinct segment within that market: cloud capacity built around accelerator chips and the high-speed networking needed to train and run large language models. Gartner’s figures show that segment grew 180% in 2025 to about $21.5 billion, and the firm now expects spending to shift from building models toward running them in everyday business applications.

    Sources

    Source: Gartner Forecasts Worldwide AI-Optimized IaaS Spending to Grow 96% in 2026 – Gartner — Gartner’s August 10, 2026 forecast of AI-optimized cloud infrastructure spending, including its inference-versus-training split.

  • Gartner: Data Center Electricity Use to Grow 26% in 2026

    Gartner: Data Center Electricity Use to Grow 26% in 2026

    Research and advisory firm Gartner has published a forecast projecting that data-center electricity consumption will grow 26% in 2026. The figure, released in June 2026, puts a number on what utilities, grid operators, and data-center builders have been experiencing on the ground: power — not land, capital, or chips — has become the binding constraint on digital-infrastructure growth.

    Executive Summary

    Gartner’s headline claim is simple: the electricity consumed by data centers will rise 26% in 2026. For context, most mature electricity systems in developed economies have spent two decades planning around annual demand growth in the low single digits. A single customer class growing 26% in one year is the kind of step-change that utility resource plans — documents typically written on five-to-fifteen-year horizons — were not designed to absorb.

    The forecast matters less as a precise number than as a planning signal. If even a substantial fraction of that growth materializes, it shapes generation procurement, transmission buildout, interconnection queues, and electricity rates for every other customer sharing the grid. For data-center operators and their customers, it also signals that access to secured, deliverable power will continue to separate projects that get built from projects that wait.

    A 26% Jump Is a Planning Problem, Not Just a Number

    Electric utilities plan in decades. Building a new gas plant, a transmission line, or a large substation typically takes years of permitting, procurement, and construction. Demand that grows 26% in a single year — even within one customer segment — compresses those timelines past what traditional integrated resource planning can handle. The practical consequence is already visible across the industry: multi-year interconnection queues (the waiting list to connect large new loads or generators to the grid), utilities demanding long-term take-or-pay commitments from data-center customers, and regulators debating who bears the cost if forecast demand fails to show up.

    The forecast, in other words, is best read as a statement about mismatch: digital infrastructure now moves at software-industry speed, while the electricity system that feeds it still moves at heavy-civil-engineering speed. Closing that gap — through faster permitting, on-site generation, or demand flexibility — is the defining infrastructure challenge the number points to.

    AI Is Rewriting the Load Curve

    Growth of this magnitude is not organic expansion of traditional enterprise computing. Conventional data-center workloads — web serving, databases, storage — grew steadily for years while efficiency gains (better chips, better cooling, higher utilization) kept electricity demand roughly flat. What changed is accelerated computing: AI training and inference run on dense GPU racks that can draw several times the power of traditional server racks and tend to run at sustained high utilization rather than in daily peaks and troughs.

    That load profile is a mixed blessing for utilities. Flat, predictable, around-the-clock demand is easier to serve than spiky demand and can improve grid economics by spreading fixed costs over more kilowatt-hours. But it also removes slack: a grid serving large always-on loads has less headroom for extreme weather events and less tolerance for generation shortfalls. How much of Gartner’s projected growth is firm, flexible, or interruptible will matter as much as the total.

    Winners, Losers, and the Power Value Chain

    If the forecast is directionally right, the beneficiaries extend well beyond data-center operators. Makers of transformers, switchgear, generators, and cooling equipment — many already quoting extended lead times — see demand visibility measured in years. Generation developers, from gas turbines to nuclear restarts to utility-scale renewables paired with storage, gain a creditworthy customer class willing to sign long-dated contracts. Utilities in data-center-heavy regions gain load growth after decades of stagnation, though with real execution and rate-design risk.

    The squeezed parties are those competing for the same electrons and equipment: other large industrial loads, smaller colocation players without utility relationships, and — if cost allocation is handled poorly — residential ratepayers. For data-center operators themselves, the forecast reinforces an emerging hierarchy: companies holding contracted, deliverable power capacity own an appreciating asset, while those still in interconnection queues hold an option of uncertain value.

    Treat the Number as a Signal, Not a Certainty

    A forecast is a model, and this one — as syndicated — arrives without its assumptions attached. Projections of AI-driven power demand have varied widely across analysts, and history urges caution: early-2000s forecasts of runaway internet power consumption overshot badly because they underestimated efficiency gains. Chip-level performance-per-watt improvements, smarter model architectures, and rising inference efficiency could all bend the curve; conversely, faster-than-expected enterprise AI adoption could steepen it.

    The even-handed reading is that Gartner’s 26% figure is a credible-sounding midpoint from an established research house, but its value depends on methodology the public headline does not disclose — baseline year, geographic scope, and workload assumptions among them. Planners should treat it as one scenario input, not a settled fact.

    Background

    Data-center electricity demand was, for roughly a decade before the AI era, a story of successful restraint: workloads migrated into ever-more-efficient hyperscale facilities, and total consumption grew far more slowly than computing output. That equilibrium broke with the generative-AI buildout that began in earnest in 2023, as operators raced to deploy GPU clusters whose power density and utilization patterns overwhelmed the old efficiency offsets. Since then, power availability has displaced real estate as the industry’s primary constraint, and forecasts from analysts, utilities, and government agencies have been repeatedly revised upward.

    Gartner, a research and advisory firm whose projections are widely used in enterprise technology planning, publishes recurring forecasts on data-center spending and infrastructure. Its June 2026 electricity-consumption forecast lands amid active debate among utilities, regulators, and operators over how much of the projected AI load will actually materialize — and who should pay to serve it.

    Source: Gartner Says Data Center Electricity Consumption to Grow 26% in 2026 — Gartner’s June 2026 forecast announcement, as syndicated via Google News.