The ‘Memory Tax’: Dell’Oro Flags HBM and DRAM Costs in AI Infrastructure

Stacked HBM memory chips beside an AI accelerator, illustrating the memory tax on AI infrastructure costs

Market research firm Dell’Oro Group has published analysis describing a growing “memory tax” on AI infrastructure — the rising share of system cost attributable to high-bandwidth memory (HBM) and DRAM in AI servers and accelerators. The note, surfaced April 27, 2026, frames memory as an increasingly material and often under-examined component of AI capital spending.

Executive Summary

Dell’Oro Group, an analyst firm that tracks data center and telecom infrastructure markets, is calling attention to memory — specifically HBM, the stacked memory packaged alongside AI accelerators, and conventional DRAM used in servers — as a fast-growing cost component in AI infrastructure. The “memory tax” framing suggests that as AI models and the clusters that train and serve them grow, memory is consuming a larger slice of every infrastructure dollar.

The framing matters because most public discussion of AI capital expenditure centers on GPUs and, increasingly, on power and data center construction. If memory costs are rising as a share of the bill of materials — the itemized cost of the components inside a server — then budget models built around accelerator pricing alone will understate the true cost of AI capacity. That has implications for cloud providers, enterprises buying AI servers, and the memory suppliers positioned to benefit.

Readers should note what is available here: a headline and thesis from a recognized analyst firm, without the underlying figures, forecast horizon, or methodology visible in the source material. The direction of the claim is consistent with the widely reported tightness in memory supply driven by AI demand, but the magnitude is not substantiated in what we can see.

Why Memory Became a Line Item Worth Naming

AI accelerators are unusual among chips in that their usefulness is bounded as much by memory as by raw compute. Training and serving large models requires moving enormous volumes of data to the processor quickly, which is why modern accelerators are packaged with HBM — DRAM dies stacked vertically and connected to the processor over a very wide, short interface. HBM is expensive to manufacture, supply is concentrated among a small number of suppliers (SK hynix, Samsung, and Micron are the established producers), and each new accelerator generation ships with more of it.

Conventional DRAM matters too: the host servers around the accelerators, plus the storage and networking tiers of an AI cluster, all consume memory. When one demand source — AI — pulls hard on a supply chain with long lead times and few producers, prices tend to rise across the board. Dell’Oro’s “memory tax” label captures the effect from the buyer’s side: a cost that arrives embedded in system prices whether or not the buyer itemizes it.

Who Pays, and Who Collects

If memory’s share of AI system cost is growing, the immediate beneficiaries are the memory manufacturers, for whom HBM commands substantially better margins than commodity DRAM historically has. Accelerator vendors sit in the middle: memory is a cost input to their products, but strong demand has so far allowed system prices to carry it. The buyers — hyperscale cloud providers, AI labs, and enterprises — absorb the tax directly in capital expenditure, and indirectly it flows into the price of cloud GPU capacity and AI services.

There is a second-order effect worth watching. Rising memory prices do not stay confined to AI hardware. General-purpose servers, storage systems, and consumer devices draw on the same DRAM supply base, so a sustained AI-driven squeeze can raise costs for infrastructure buyers who are not purchasing AI systems at all. For data center operators and IT planners, that argues for treating memory pricing as a market variable in refresh budgets, not a constant.

An Analyst Thesis, Not a Dataset — Yet

It is worth being precise about the evidentiary weight of what has surfaced. Dell’Oro is an established infrastructure research firm, and the thesis aligns with observable market conditions. But the material visible here is a headline-level framing: it does not disclose how large the memory share of AI system cost currently is, how fast it is growing, or over what forecast period. “Growing” is directionally plausible and quantitatively unverified in this source.

That distinction matters for anyone using the claim to make decisions. A memory share that rises from, say, a modest slice to a dominant one would reshape supplier negotiations and cloud pricing; a gradual drift would be a planning footnote. Until the underlying figures are public, the responsible reading is that memory costs deserve a named line in AI infrastructure budgets — and that the size of that line needs data the summary does not provide.

Background

The AI infrastructure buildout that accelerated from 2023 onward has been discussed mostly in terms of GPUs, power, and data center construction, but every AI accelerator ships with a large complement of high-bandwidth memory, and every cluster consumes conventional DRAM in its servers and supporting systems. Memory is a historically cyclical market dominated by a small number of manufacturers — SK hynix, Samsung, and Micron — and AI demand has become a defining force in its current cycle.

Dell’Oro Group, founded in the 1990s and based in Silicon Valley, publishes recurring research on data center capex, servers, and network infrastructure. Its analysts’ framing of trends — in this case, memory as a “tax” on AI infrastructure — often shapes how vendors and buyers talk about market economics before detailed figures circulate publicly.

Source: The Growing Memory Tax on AI Infrastructure — Dell’Oro Group, analyst commentary on rising HBM and DRAM costs in AI infrastructure economics, published April 27, 2026.