Tag: interconnection queues

  • SenseTime’s 80% Tokens-Per-Watt Gain Pulls the Grid Inside AI’s Efficiency Math

    SenseTime’s 80% Tokens-Per-Watt Gain Pulls the Grid Inside AI’s Efficiency Math

    TL;DR · 30-second read

    The Short Version

    Artificial intelligence computers draw electricity in sudden bursts, which can jolt the power grid the way a heavy factory switching on and off does. At a conference in Shanghai, Huawei showed gear meant to let large AI computing sites soak up those swings with batteries, and even help steady the grid instead of straining it.

    It also pushed a different scorecard. Instead of measuring how much power a building wastes, measure how much useful artificial intelligence work each unit of electricity buys. The Chinese firm SenseTime says it has improved that figure by 80 percent.

    Huawei used the HUAWEI AIDC Facility Summit, held alongside HUAWEI CONNECT 2026 in Shanghai on September 20, 2026, to launch what it calls a grid-interactive AIDC solution — a package of power and cooling equipment for AI data centers built around what the company labels “3+1” innovations. The announced version 1.0 combines a grid-friendly uninterruptible power supply, intelligent lithium batteries and grid-forming energy storage, alongside an AI-managed liquid cooling system that predicts the condition of its working fluids to schedule maintenance before failures. In the power domain, Huawei also outlined a longer-horizon “MIMO” power supply architecture.

    Hou Jinlong, Director of the Board of Huawei and President of Huawei Digital Power, opened the summit with four design arguments: pairing new power architecture with liquid cooling, using multi-layer hybrid storage to absorb local power fluctuations, coupling electricity and compute so data centers stop behaving as rigid loads, and shifting to modular, prefabricated delivery to cut construction lead times. Speakers from VNET Group and SenseTime shared the stage; SenseTime’s Lin Hai said end-to-end optimization had improved SenseCore’s tokens per watt by 80%.

    Executive Summary

    The substance of the announcement is architectural rather than financial. Huawei is proposing that an AI data center should be designed as a participant in the power system — able to hold its own voltage and frequency behavior steady through grid-forming storage, and to buffer the second-to-second swings that large training and inference clusters impose — rather than as a fixed block of demand that a utility must simply serve.

    That framing matters because grid connection, not construction, is increasingly what sets the calendar for AI capacity. A site that arrives at the utility as a controllable, power-quality-friendly asset is a different negotiation from one that arrives as raw megawatts of volatile load. Huawei’s pitch, delivered by Digital Power Vice President Bob He, is that as renewables raise the share of power-electronic sources on the grid, compute and energy infrastructure can no longer be planned independently.

    The second half of the pitch is a measurement change. Huawei and SenseTime both argued for scoring AI facilities on tokens per watt — useful model output per unit of electricity — instead of power usage effectiveness, the long-standing ratio of total facility power to IT power. That is a bigger change than it sounds, because it moves the boundary of the efficiency calculation outward to the grid and inward to the model at the same time.

    Why a Data Center Would Want to Look Like a Grid Asset

    A conventional data center is, from a utility’s point of view, a well-behaved but inflexible customer: it wants a large, constant, highly reliable supply and offers nothing back. AI clusters break the “well-behaved” half. Synchronized training jobs can ramp thousands of accelerators together, producing what the release describes as rapid and severe power fluctuations, and Huawei’s speakers named the consequences utilities worry about — disconnection events and unstable wideband oscillation, meaning sustained electrical ringing across a range of frequencies that neither the site nor the grid damps out.

    The engineering answer Huawei describes is layered storage sitting between the workload and the grid. Batteries and grid-forming inverters absorb the swing locally, so the fluctuation never reaches the interconnection point; grid-forming units go further by actively setting voltage and frequency rather than following the grid, which is what allows a site to support a network with a high share of inverter-based renewable generation instead of leaning on it. VNET Group Founder and Chairman Josh Chen extended the idea to campus scale, describing direct green power connections, active microgrids and direct-current distribution inside buildings as the way to serve gigawatt-class AI campuses.

    The commercial logic follows from scarcity. When interconnection capacity is the binding constraint on AI buildout, the cheapest new megawatt is often the one a developer does not have to request. Equipment that lets a site ride through disturbances, shave its own peaks and behave predictably at the meter is, in effect, a substitute for grid capacity that has not been built yet — and a bargaining chip in queue discussions. Huawei has not published evidence on how much connection time or capacity this saves in practice, which is the number that would turn the argument into a business case.

    Tokens Per Watt Redraws the Boundary of the Efficiency Question

    Power usage effectiveness has governed data center efficiency for two decades. It is a facility-boundary ratio: total power into the building divided by power reaching the IT equipment. It says nothing about whether the servers do anything useful. Once a site is spending most of its energy on inference, that blind spot becomes the main event — a facility can post an excellent PUE while running inefficient hardware on badly scheduled work.

    Tokens per watt closes that gap by measuring output rather than overhead, and this is where the 80% figure does its work. SenseTime’s Lin Hai described SenseCore’s improvement as end-to-end, spanning power plants and grids, rack services in the data center, compute cloud services and model services. That is the whole chain, not the mechanical plant. A number of that size is therefore not evidence that any single piece of equipment got 80% better; it is evidence that when you draw the measurement boundary that wide, most of the available gain sits in layers the facility team has never been scored on — and, at the far end, in the grid supplying the site. Huawei’s Hou Jinlong put the same point commercially: maximizing tokens per watt and minimizing cost per token will be the core competitiveness of what he called compute factories.

    Who this affects is concrete. Colocation operators sell space, power and a PUE commitment; they do not control the model, the scheduler or the chip, so they cannot be held to a tokens-per-watt number without a very different contract. Chip vendors and inference-software teams gain, because their contribution finally appears in the facility scorecard. Utilities gain a vocabulary for load that varies in usefulness as well as size. The catch is standardization: tokens differ by tokenizer, model and precision, so an 80% improvement is a credible internal engineering result and not yet a figure that can be compared across operators. No published methodology accompanied the claim.

    The Delivery Clock and the Question of Who Can Buy It

    Hou’s fourth argument — modular, prefabricated, product-based delivery to shorten lead time — is the least glamorous and arguably the most operationally consequential. In a market where the constraint is time to first megawatt, converting site-built electrical and cooling systems into factory-built blocks shifts the schedule risk from a construction crew to a production line. It also suits Huawei’s structural position: the company is selling the power chain and the cooling chain and the compute stack, and Bob He explicitly named end-to-end energy plus full-stack AI as the differentiator.

    That integration is genuinely hard for point-product vendors to match, and it is also the strongest argument against buying it. A grid-interactive architecture in which the uninterruptible power supply, the batteries, the grid-forming storage, the liquid cooling controller and the workload scheduler are co-designed is, by construction, difficult to unbundle later. Buyers evaluating it should ask what the interfaces are and whether any layer can be swapped — questions the launch materials do not address.

    Market context also shapes who this is for. The named practitioners on stage — VNET and SenseTime — are China-based, and the summit sat inside a conference where Huawei also presented an upgraded Stellar AI Network solution and released its Intelligent World 2035 report series setting out ten key directions. The ideas here travel further than the product does: measuring output per watt, buffering workload volatility on site and offering grid services are design responses any operator facing a long interconnection queue will recognize, whatever equipment ends up in the building.

    Background

    Huawei Digital Power is the Huawei division that sells power conversion, energy storage, solar inverter and data center power and cooling systems — a business adjacent to, but distinct from, the company’s networking and computing lines. Its data center pitch has increasingly merged with Huawei’s AI compute strategy, on the argument that the electricity system and the compute system are now a single engineering problem. HUAWEI CONNECT is the company’s annual flagship conference; the 2026 edition in Shanghai also produced an upgraded Stellar AI Network solution and a set of Intelligent World 2035 research reports laying out ten key directions.

    The wider context is a buildout constrained by electricity rather than silicon supply alone. Racks designed for AI accelerators draw many times what general-purpose servers did, pushing operators to liquid cooling and to far larger grid connections, while utilities in many markets face multi-year queues to study and approve new large loads. That has pushed the industry toward on-site generation, storage and demand flexibility, and toward efficiency metrics that account for useful work rather than facility overhead. VNET Group is a Chinese carrier-neutral data center operator; SenseTime is a Chinese AI company whose SenseCore platform runs its own intelligent computing centers.

    Sources

    Source: Huawei Grid-Interactive AIDC Solution: Shaping the New Paradigm of AI Infrastructure — Huawei’s September 20, 2026 announcement from the HUAWEI AIDC Facility Summit in Shanghai, detailing the grid-interactive AIDC 1.0 solution and remarks from Huawei, VNET Group and SenseTime executives.

    Primary sources: Huawei представляет инновационное решение в области иммерсивного телеприсутствия, которое предлагает эффект погружения и интеллектуальные услуги (Huawei’s September 20, 2026 immersive telepresence announcement from the same conference); Huawei представляет обновленную сеть Stellar AI для обеспечения безопасного и интеллектуального подключения к агентскому миру (the upgraded Stellar AI Network solution presented at HUAWEI CONNECT 2026 on September 18, 2026); В последнем отчете Huawei предлагаются 10 ключевых направлений Интеллектуального мира-2035 (Huawei’s September 18, 2026 launch of its Intelligent World 2035 report series).

  • AI’s Power Surge Is Forcing a Ground-Up Rethink of Data Center Design

    AI’s Power Surge Is Forcing a Ground-Up Rethink of Data Center Design

    Bloomberg published a deep-dive feature, “The Race to Rethink Data Centers for AI’s Power Surge” (May 31, 2026), examining how the electricity demands of artificial intelligence are pushing the industry to redesign data centers from the ground up. The syndicated item carries the headline and framing rather than the full text, but the thesis is clear: AI has turned the data center from a real-estate product into a power-engineering problem, and the industry is racing to catch up.

    Executive Summary

    The framing matters because it comes from a general-audience financial outlet, not a trade publication. When Bloomberg tells its readership that data centers must be rethought — not incrementally upgraded — it signals that AI infrastructure has become a mainstream capital-markets story. The “race” in the headline is real: operators, chipmakers, cooling vendors, and utilities are all redesigning around a single constraint, the availability and delivery of electric power.

    For a decade, data center design evolved slowly because the workload was predictable: web servers, storage, and enterprise applications drawing modest, steady power per rack. AI training and inference clusters broke that model. Racks packed with modern AI accelerators draw many times the power of traditional server racks, concentrate that power in small footprints, and generate heat that air cooling struggles to remove. Every downstream system — electrical distribution, cooling, floor loading, even site selection — inherits that change. That is the ground-up redesign Bloomberg describes.

    From Real Estate to Power Engineering

    The traditional data center business resembled specialized real estate: build a shell near fiber routes, sell space and a service-level agreement. AI inverts the priority order. The scarce input is no longer land or connectivity but grid capacity — the megawatts a utility can actually deliver to a site, and how soon. In many major markets, interconnection queues (the utility’s waiting list to hook up large new loads) now stretch years, which means the design question starts with “where can we get power?” before anyone draws a floor plan.

    That shift changes who holds leverage. Utilities and transmission owners, long treated as background vendors, now effectively gate the industry’s growth rate. Operators that secured power commitments early, or that can bring generation and storage to the site themselves, hold an asset that cannot be quickly replicated. This is why data center announcements increasingly lead with gigawatts rather than square feet.

    The Density Problem: Why Air Is No Longer Enough

    AI accelerators concentrate enormous computation — and therefore heat — into small spaces. Racks that once drew power in the single-digit kilowatts have given way to AI clusters drawing an order of magnitude more, and air cooling becomes physically impractical at those densities. The industry’s answer is liquid cooling: circulating coolant directly to chips or immersing hardware entirely, because liquids carry heat far more efficiently than air.

    Retrofitting liquid cooling into a facility designed for air is expensive and disruptive — new piping, new heat-rejection equipment, reinforced floors, redesigned electrical distribution. That is what makes this a ground-up redesign rather than an upgrade cycle: much of the world’s existing data center stock was simply not built for what AI hardware now requires. New builds can be purpose-designed; legacy facilities face hard choices between costly conversion and serving the workloads they were built for.

    Winners, Losers, and the Retrofit Divide

    The redesign wave creates clear beneficiaries: liquid-cooling specialists, electrical-equipment manufacturers, builders of on-site generation and battery storage, and operators with new, high-density-capable campuses. Utilities in data-center-heavy regions gain large, creditworthy customers — along with political scrutiny over who pays for grid upgrades and how large loads affect residential rates.

    The pressure falls on owners of older facilities and on markets where power is constrained. A bifurcation is plausible: purpose-built AI campuses commanding premium economics, while conventional facilities compete in the lower-growth market for traditional enterprise workloads. For the broader industry, the open question is pacing — whether power delivery, equipment supply chains, and skilled construction labor can scale as fast as AI demand projections assume, and what happens to capital deployed against those projections if demand growth moderates.

    What It Means for Buyers of Capacity

    Enterprises buying colocation or cloud capacity should read this as a warning about lead times and pricing. When power is the bottleneck, capacity in constrained markets gets scarcer and more expensive, and delivery dates slip to match utility timelines rather than construction schedules. Buyers planning AI deployments should ask providers pointed questions: how much power is actually contracted (not just applied for), what rack densities the facility supports today, and whether liquid cooling is installed or merely on a roadmap. The gap between a marketing deck and an energized megawatt is where AI projects stall.

    Background

    For most of the 2010s, data centers evolved gradually around predictable enterprise and cloud workloads, with racks drawing modest power and air cooling as the near-universal standard. The generative AI boom that began in late 2022 broke that pattern: training and serving large AI models requires dense clusters of accelerator chips whose power draw and heat output far exceed what conventional facilities were designed to handle. Since then, hyperscalers and data center developers have announced successive waves of AI-focused capacity, and the industry’s public conversation has shifted from square footage to megawatts — with power procurement, cooling technology, and grid constraints emerging as the defining issues of the buildout. Bloomberg’s May 2026 feature places that redesign race in front of a mainstream financial audience.

    Source: The Race to Rethink Data Centers for AI’s Power Surge — Bloomberg deep-dive feature (May 31, 2026) on how AI’s electricity demands are driving a ground-up redesign of data center architecture.