jain.com — data centers, connectivity and security, analyzed daily

Tag: Google TPU

  • Broadcom Stock Slips Despite Soaring AI Chip Outlook: Why Investors Hesitate

    Broadcom Stock Slips Despite Soaring AI Chip Outlook: Why Investors Hesitate

    TL;DR · 30-second read

    The Short Version

    Broadcom, one of America’s biggest chipmakers, reported sales that nearly doubled from a year earlier. It also predicted its artificial intelligence chip business will roughly quadruple by 2028. Its stock still slipped about 3%.

    One worry: much of that future growth depends on just three buyers. Those are Google and the chatbot makers OpenAI and Anthropic. If any of them spends less, Broadcom feels it fast.

    Broadcom’s chips power many of the artificial intelligence tools people now use. That makes its fortunes a rough gauge of whether the spending boom lasts.

    Broadcom reported fiscal third-quarter results on September 2 and filed its quarterly report (a 10-Q) with the SEC on September 10, covering the three months ended August 2, 2026. Morningstar reported that the shares fell 3% after the release, even though, by Morningstar’s calculation, the August-quarter results implied 86% year-on-year growth and October-quarter guidance implied 93%.

    Management also issued an outlook running through 2028. It calls for artificial intelligence revenue to quadruple from 2026 levels and for non-GAAP earnings per share, a measure that excludes items such as acquisition-related charges, to nearly triple to $30. Broadcom said OpenAI and Anthropic will become its two largest customers starting in 2027. It also pointed to a multiyear agreement with Google covering its custom AI chips.

    Executive Summary

    On paper, this was an exceptional report. Broadcom designs custom AI accelerators, which are chips built to one customer’s specification rather than sold off the shelf. It told investors that demand for them will keep compounding for at least two more years. The company supplies Google’s eighth-generation inference TPU, the tensor processing unit Google uses to run trained AI models for users. It expects enormous volume ramps at OpenAI and Anthropic. Morningstar, which rates the stock five stars with a $650 fair value estimate, said the 2028 guidance beat its own model.

    The muted stock reaction is the more interesting signal. Morningstar noted the shares had fallen nearly 30% since the previous quarter. It read that decline as the market pricing in a risk that Broadcom misses its 2028 targets or that growth slows afterward. Long-dated guidance, however bullish, asks investors to trust a handful of customers’ spending plans years in advance. For many investors, that trust now comes with conditions: which customers, on what terms, and at what profitability.

    For the wider infrastructure market, Broadcom’s outlook is a direct read on how aggressively the largest AI developers intend to build out computing capacity. It also shows how much of that capacity will run on custom silicon rather than general-purpose GPUs.

    Great Numbers, Skeptical Market

    Broadcom’s guidance is unusually specific and unusually far out. Most chip companies guide one quarter ahead. Broadcom put figures on 2028: AI revenue up fourfold from 2026 and roughly $30 of non-GAAP earnings per share. Morningstar calls the guidance credible and argues underlying AI infrastructure demand will keep rising through 2030. The market’s reaction was more cautious. A 3% post-earnings dip followed a slide of nearly 30% since the prior quarter.

    That gap between guidance and share price reflects a familiar tension in AI hardware. Investors reward growth, but they discount growth that depends on a few enormous purchase decisions. When a company’s outlook already assumes a quadrupling, even strong confirmation can fail to move the stock. The debate shifts from whether demand exists to whether it holds beyond the guided window, and at what price.

    Morningstar’s valuation shows how much future growth is embedded in its $650 estimate. That figure implies adjusted price-to-earnings multiples of 56 times fiscal 2026 and 34 times fiscal 2027, falling to 22 times on 2028 estimates. Put simply, the estimate looks reasonable only if the 2028 earnings arrive.

    Diversifying Away From Google, Into Frontier Labs

    Google has long been Broadcom’s anchor customer in custom accelerators. Two developments this quarter complicate that picture. First, Google split its TPU program: Broadcom supplies the inference chip, while MediaTek won the training chip, which is used to build the models in the first place. Morningstar argues the inference part is higher in volume and complexity. Still, the split shows that even Broadcom’s largest customer is willing to multisource.

    Second, Broadcom expects OpenAI and Anthropic to overtake Google as its biggest customers from 2027. That diversifies Broadcom away from a single buyer. It also shifts exposure toward frontier-model developers, whose infrastructure budgets depend on how their own businesses and funding evolve. Morningstar acknowledges investors may worry about this spending but argues it is supported by improving AI model economics. That claim will be tested over the next two years rather than settled by this report.

    Morningstar assigns Broadcom a High Uncertainty Rating and names customer concentration as its primary risk. The AI accelerator business rests on a handful of high-spending customers. Shifts in any one customer’s spending patterns can swing results and sentiment.

    The Margin Question Behind the Growth

    Broadcom is known for profitability. Morningstar credits it with free cash flow margins consistently above 40%, meaning over 40 cents of every revenue dollar becomes cash after capital spending. It projects free cash flow exceeding $50 billion a year by fiscal 2027. Much of that reputation was built on a mix of networking chips and infrastructure software, including VMware, acquired in 2023.

    As custom accelerators grow to dominate revenue, investors will want to know whether profitability holds as the mix changes. Custom chips are negotiated with a few very large buyers who have real bargaining power, as Google’s decision to bring in MediaTek suggests. Morningstar’s bear case also flags moderating growth in Broadcom’s legacy software lines. That makes the economics of the AI business more important to the overall margin picture, not less.

    None of this contradicts the demand story. It explains why demand alone may no longer be enough: investors are asking what each dollar of AI revenue is worth, not just how many dollars are coming.

    Supply, Debt and Leadership

    Broadcom depends heavily on TSMC to manufacture its chips, so any capacity constraint could limit how quickly it ships to customers. Morningstar believes Broadcom would be a priority TSMC customer because of its scale and long relationship. Even so, a quadrupling of AI revenue requires a matching step-up in manufacturing allocation.

    The balance sheet looks manageable. As of October 2025, Broadcom held $16 billion in cash against $65 billion of gross debt, roughly half tied to VMware. Its gross debt-to-adjusted EBITDA ratio fell from 3.5 times after the deal to 1.5 times by the end of fiscal 2025. EBITDA stands for earnings before interest, taxes, depreciation and amortization. Leadership is a longer-term consideration. Morningstar identifies CEO Hock Tan as integral to Broadcom’s acquisition and operating strategy; he is contracted with the company through 2030, within the window in which the AI ramp is meant to play out.

    Background

    Broadcom is a semiconductor and infrastructure software company led by CEO Hock Tan, who has built it largely through acquisitions run for high efficiency. The largest recent deal was the 2023 purchase of virtualization software maker VMware. Broadcom reports revenue from products and from subscriptions and services, across the Americas, Asia Pacific and EMEA. In recent years its growth engine has become custom AI accelerators: chips it co-designs with large technology companies, beginning with Google’s TPU program.

    Custom silicon has become a major alternative to off-the-shelf GPUs for companies spending heavily on AI computing. Its appeal is performance and cost tuned to one customer’s workloads. Broadcom’s traditional networking chips and VMware software still generate substantial cash flow, but the AI chip business is now the primary driver of its valuation. Its results are therefore closely watched as a barometer for AI infrastructure spending.

    Sources

    Source: Broadcom Stock Fell 3% After Earnings Despite Immense AI Chip Demand (Morningstar), Morningstar’s analysis of Broadcom’s fiscal third-quarter results and 2028 outlook.

    Primary sources: Broadcom Inc. Form 10-Q for the quarter ended August 2, 2026 (SEC EDGAR, filed September 10, 2026).

  • Google TPU v8 vs Nvidia: Inference Is Redrawing the AI Compute Map

    Google TPU v8 vs Nvidia: Inference Is Redrawing the AI Compute Map

    On May 29, 2026, investment research firm IO Fund published an analysis arguing that Google’s eighth-generation Tensor Processing Unit (TPU v8) represents a meaningful challenge to Nvidia’s dominance of AI computing — and that the industry’s shift from training AI models to running them, known as inference, is rewriting who captures value in the AI market.

    The piece is analyst commentary rather than a company announcement: neither Google nor Nvidia issued the claims, and the material available does not include chip specifications, benchmarks, pricing, or customer commitments.

    Executive Summary

    The thesis at the center of the analysis is straightforward: the AI compute market that Nvidia came to dominate was built on training — the enormously expensive, one-time process of teaching a model. As AI products mature, spending shifts toward inference — the everyday work of answering queries, generating text and images, and serving applications to users. Inference runs continuously, at massive scale, and its economics reward cost-per-query and energy efficiency over raw peak performance.

    Google is the one hyperscaler that has designed its own AI accelerator across eight generations, and it both consumes TPUs internally and rents them to customers through Google Cloud. If inference becomes the dominant workload, the argument goes, a vertically integrated chip tuned for serving costs could take share that merchant GPUs currently hold by default.

    Why it matters: even a partial shift of inference workloads to non-Nvidia silicon would ripple through chip suppliers, cloud pricing, and the design of the data centers that house all of it. But readers should note what is being claimed versus what is being shown — the source material asserts the competitive framing without publishing head-to-head performance or cost data.

    From Training Arms Race to Inference Economics

    Training a frontier AI model is a capital project: a huge cluster runs for weeks or months, and buyers pay almost any price for the fastest available hardware. Inference is an operating expense: every chatbot reply, search summary, and generated image is a small compute job repeated billions of times. That changes the buying criteria. For training, time-to-result dominates; for inference, what matters is cost per token served, latency, and performance per watt — how much useful output a chip produces for each unit of electricity.

    This is why analysts increasingly frame inference as the market’s center of gravity. A workload that runs 24/7 in production is exquisitely sensitive to efficiency, and a chip that is modestly slower but meaningfully cheaper to operate can win business that a peak-performance chip cannot. The IO Fund headline captures that logic; what the available material does not provide is data quantifying how TPU v8 actually performs on those metrics against Nvidia’s current parts.

    Custom Silicon and the Limits of the CUDA Moat

    Nvidia’s advantage has never been hardware alone. CUDA, its programming platform, is the software layer nearly all AI development targets, and switching away from it carries real engineering cost. That moat is strongest where code is bespoke and experimental — which describes training research well. Inference is different: production models are increasingly served through standardized frameworks and compilers that can target multiple chip types, lowering the switching cost that protects the incumbent.

    Google’s structural position is also unusual. Unlike merchant chipmakers, Google does not need to win sockets in other companies’ data centers to justify TPU development — its own search, ads, and Gemini workloads provide guaranteed internal demand, and Google Cloud monetizes the surplus. Amazon and Microsoft have followed the same playbook with their own accelerators. The open question, which the source material does not answer, is whether any hyperscaler chip has yet attracted large third-party inference workloads at scale, or whether custom silicon remains mostly an internal cost-reduction tool.

    What Inference-First Compute Means for Physical Infrastructure

    The training-to-inference shift is not just a chip story; it reshapes data centers. Training concentrates compute in a few gigawatt-scale campuses. Inference pulls in the opposite direction: serving users at low latency favors capacity distributed closer to population centers, with high-bandwidth connectivity to move requests and responses rather than model weights. For data center operators and network providers, an inference-heavy market means demand for more sites, in more markets, with different power and cooling profiles than monolithic training clusters.

    Efficiency claims matter here too. Power availability is the binding constraint on data center growth in most major markets, so performance-per-watt improvements in accelerators translate directly into how much AI capacity a given substation can support. Any credible challenger to Nvidia will be judged as much on watts as on FLOPS — a reminder that the AI market’s referee is increasingly the electric grid.

    Reading the Claim Like a Buyer

    For enterprises and cloud customers, the practical takeaway is not to pick a winner but to price the competition. A credible TPU alternative — even one adopted mainly inside Google — pressures accelerator pricing and cloud inference rates across the board, because Nvidia’s largest customers gain negotiating leverage. Buyers evaluating platforms should ask vendors for workload-specific benchmarks (their models, their traffic patterns) rather than headline chip comparisons, and should weigh portability: an inference stack built on open frameworks preserves the option to chase better economics as this rivalry plays out.

    It is equally fair to stress-test the bear case on Nvidia. The company has repeatedly absorbed inference-era challenges by iterating its own inference-optimized products and software, and market-share shifts in semiconductors tend to be slower than analyst narratives suggest. A headline announcing that the market is being ‘rewritten’ is a thesis, not a measurement — and the same skepticism should apply to Google-favorable and Nvidia-favorable framings alike.

    Background

    Google disclosed its first Tensor Processing Unit in 2016, making it the earliest hyperscaler to design custom AI silicon rather than rely solely on merchant chips. Successive TPU generations scaled from internal inference workloads to full training clusters offered through Google Cloud, and the seventh generation, Ironwood, announced in April 2025, was explicitly positioned as an inference-first chip — a signal of where Google believed the market was heading.

    Nvidia, meanwhile, converted its graphics-processor franchise into overwhelming leadership of AI training hardware, propelled by the generative-AI buildout that began in late 2022 and reinforced by its CUDA software ecosystem. The tension between merchant GPUs and hyperscaler custom silicon — Amazon’s Trainium, Microsoft’s Maia, Google’s TPUs — has become one of the defining structural questions of the AI infrastructure market, and the training-versus-inference spending mix is the variable most likely to decide it.

    Source: Google TPU v8 vs Nvidia: How Inference Is Rewriting the AI Market — IO Fund analysis, published May 29, 2026, arguing that the shift from AI training to inference is reshaping competition between Google’s custom TPU silicon and Nvidia’s GPUs.