Tag: AI inference

  • CoreWeave’s 15x Reload Claim Puts AI Inference on the Training Critical Path

    CoreWeave’s 15x Reload Claim Puts AI Inference on the Training Critical Path

    TL;DR · 30-second read

    The Short Version

    CoreWeave is a company that rents out the powerful computer chips used to build artificial intelligence. It has now launched Forge, a software toolkit for building and running artificial intelligence systems. Anyone can start using it for free.

    The surprising part: when these systems learn by trial and error, they keep swapping in updated versions of themselves. CoreWeave says it made that swap 15 times faster in testing, so the learning stops stalling.

    The move also puts CoreWeave in more direct competition with Amazon, Google and Microsoft, which already sell similar toolkits.

    CoreWeave has launched CoreWeave Forge, a platform that connects model serving, observability, post-training and evaluation in one environment. It was unveiled at the Fully Connected event and is free to start, with paid tiers for additional capabilities. CoreWeave’s product page describes Forge as a way to “run, observe, curate, improve, and evaluate models and agents” without locking work to one cloud, model or framework.

    SiliconANGLE reported on October 8 that Urvashi Chowdhary, CoreWeave’s vice president of product and AI services, said a preview capability called CoreWeave RL Rollouts, built on Nvidia’s Dynamo framework, improved model reload latency by 15x compared with a baseline configuration in testing.

    Executive Summary

    CoreWeave built its business renting GPU capacity, the graphics processors that train and run AI models. Forge adds managed software on top of that capacity. According to CoreWeave’s product page, it covers fine-tuning, managed reinforcement learning, per-token serverless inference, dedicated inference, agent tracing, sandboxes, a model and dataset registry, and experiment tracking through Weights & Biases Models. The free entry tier extends the platform to individual developers, not only the large labs and enterprises that sign capacity contracts.

    The most technically significant claim concerns reinforcement learning, the training method used to build agentic models that take multistep actions. In that workflow, the inference system that generates the model’s attempts has to keep reloading freshly trained versions of the model. CoreWeave says RL Rollouts cut that reload time 15-fold in testing. If that holds outside the lab, inference performance becomes a direct constraint on how fast these models can be trained, which changes how teams should size and buy GPU capacity.

    Commercially, Forge places CoreWeave alongside hyperscaler AI platforms such as Amazon Bedrock and SageMaker, Google Vertex AI and Microsoft Azure AI Foundry. Its distinguishing pitch is an open-source foundation and portability across clouds, models and frameworks.

    Inference Is Now on the Training Clock

    In conventional AI development, training and inference are separate phases. A model learns from a fixed dataset, and inference, meaning serving the model to answer requests, comes afterward. Reinforcement learning for agentic models erases that boundary. The model generates attempts at a task, called rollouts. Verifiers check the results and rewards score them, and those scores update the model. Each update produces a new checkpoint, a saved snapshot of the model’s weights, which must be loaded back into the inference servers that produce the next round of attempts. Chowdhary described inference as the bottleneck during rollouts, and the mechanics show why: every reload is time the loop spends waiting.

    That is the problem the 15x figure addresses. CoreWeave RL Rollouts is built on Nvidia’s Dynamo, an open-source framework for distributing inference across many GPUs. It loads new checkpoints into a live deployment, and Chowdhary said the approach improved model reload latency 15-fold against a baseline configuration. The practical effect, in Chowdhary’s framing, is that training keeps moving while inference scales independently. This matters to the people who plan and buy GPU capacity. When inference sits inside the training loop, the size and responsiveness of the inference fleet partly determine training throughput. Teams can no longer budget the two as unrelated line items.

    The claim deserves careful reading. The baseline configuration has not been specified. The figure comes from testing. The capability is in preview. Reload is also only one step in each loop iteration, alongside generating rollouts, scoring them and updating weights, so a 15x gain in reload time does not translate into a 15x gain in end-to-end training speed. CoreWeave has not quantified that overall effect. The direction of the argument is sound. Its magnitude in production is still unproven.

    From GPU Landlord to Platform Vendor

    CoreWeave’s product page lays out Forge as a five-stage loop. Teams run models and agents, observe them through traces in Agent Lens, curate failures into versioned datasets, improve the model through fine-tuning, reinforcement learning or distillation, and evaluate the new version before it ships. Pricing models span per-token serverless inference on open models and dedicated inference, where a customer’s own weights run on GPUs it chooses. Chowdhary described the strategy as building managed services in layers on top of the infrastructure, so that each service builds on the others.

    The economic logic is familiar from the hyperscalers. Raw GPU capacity is easiest to sell when it is scarce, and it is easiest to compare on price when it is not. Software layers give a provider other ways to compete. Customers who keep their experiments, traces, datasets and model registry on one platform have reasons to stay. Per-token pricing lets the provider capture value from efficiency gains on hardware it already owns. The free tier widens the funnel to individual developers who would never sign a capacity contract. Amazon, Google and Microsoft have pursued the same strategy for years by bundling compute with managed AI platforms. Forge is CoreWeave’s entry into that contest.

    CoreWeave’s chosen point of difference is openness. Chowdhary emphasized open-source tools such as vLLM and contributing back to open projects, and the product page promises work that is not locked to one cloud, model or framework. That is a credible counter to proprietary platform stacks. It also creates a tension the company will have to resolve in practice, because an integrated, connected loop is valuable precisely because it is sticky. Portability will be judged by how easily customers can move data, traces and registry entries out, not by the launch language.

    Reading the Inference Demand Signal Carefully

    The demand case rests on one data point. In a theCUBE Research survey of CoreWeave customers and prospects, one healthcare customer’s share of inference workload rose from about 10% in its first year to 40% in its second, with roughly 50% expected within 12 months. That fits the thesis that serving models, not training them, will drive the next phase of AI cloud economics. However, it is a single customer drawn from CoreWeave’s own customer base. It illustrates a trend and does not measure one.

    The infrastructure implication still holds. As more of a GPU’s working life goes to serving requests, providers compete on how much useful output each GPU produces. CoreWeave lists Nvidia’s Hopper, Blackwell and Vera Rubin generations, which competitors can also buy. When the hardware is shared, efficiency comes from the software above it. Chowdhary pointed to that layer: the vLLM serving engine, quantized models, which use lower-precision numbers to shrink a model and speed it up, and custom speculative decoders, in which a small draft model proposes output that the large model verifies. Forge packages that tuning as a product. Over time, it could matter as much as the size of the fleet.

    Background

    CoreWeave began as a GPU-based cryptocurrency operation and pivoted to become a specialized AI cloud, renting large clusters of Nvidia GPUs to AI labs and enterprises. It listed on Nasdaq under the ticker CRWV in 2025 and acquired Weights & Biases, the AI experiment-tracking company, the same year. That tooling now sits inside Forge. Its infrastructure catalog spans Nvidia’s Hopper, Blackwell and Vera Rubin GPUs, managed Kubernetes, AI object storage and fleet-management software.

    Specialized GPU clouds grew on demand for model training, which consumes large blocks of capacity for weeks at a time. As AI products reach users, inference, the continuous work of running models to answer requests, takes up a growing share of compute. That has pushed providers to compete on software efficiency and managed services, the territory where Amazon Web Services, Google Cloud and Microsoft Azure have long operated.

    Sources

    Source: AI inference gets a full stack as CoreWeave launches Forge — SiliconANGLE’s interview with CoreWeave’s Urvashi Chowdhary on Forge, inference optimization and RL Rollouts.

    Primary sources: CoreWeave Forge → Models, agents, training, and inference (CoreWeave product page).

  • VIAVI’s 100G Tester Makes Post-Quantum Overhead on AI Traffic a Pre-Launch Number

    VIAVI’s 100G Tester Makes Post-Quantum Overhead on AI Traffic a Pre-Launch Number

    TL;DR · 30-second read

    The Short Version

    A new generation of encryption is coming, built to withstand future quantum computers that could one day crack today’s codes.

    The catch: stronger locks can mean more work for the equipment that handles every connection, including the chatbots and other artificial intelligence services businesses now run.

    VIAVI, a maker of network testing gear, released a pizza-box-sized machine that floods networks with realistic, quantum-safe encrypted traffic, so companies can find out whether the new locks slow things down before customers notice.

    VIAVI Solutions (NASDAQ: VIAV) introduced the CyberFlood CF50 on September 29, 2026, a one-rack-unit (1U) test appliance that generates realistic encrypted application traffic at up to 100 gigabits per second (100G) to test application performance, security controls, AI inference and large language model (LLM) services. VIAVI said the CF50 includes native support for post-quantum cryptography (PQC), delivers TLS performance 1.75 times that of its nearest competitor, and has the industry’s lowest power consumption in its class.

    The CF50 is aimed at network equipment manufacturers, systems integrators and service providers, and sits below the existing CyberFlood CF1000, which VIAVI targets at large enterprises that need the highest performance.

    Executive Summary

    The CF50 is a traffic generator: it impersonates large numbers of users and applications so that engineers can see how firewalls, gateways, load balancers and AI services behave under load before real customers arrive. What distinguishes it, by VIAVI’s account, is that it combines three things in a small box: Layer 4-7 traffic (traffic that looks like real applications rather than raw data packets), security assessment, and AI inference testing, with post-quantum encryption built in.

    That combination matters because two infrastructure transitions are happening at once. Organizations are putting AI inference, the step where a trained model answers requests, into production over encrypted connections, and they are preparing to move those connections to quantum-resistant encryption. Both place new demands on the same security equipment. A tester that can generate both kinds of traffic turns the question of whether post-quantum encryption slows AI services into something a lab can measure rather than something operations teams discover after launch.

    The headline performance claims, 1.75X TLS performance and lowest power consumption, are VIAVI’s own, and the company has not published the competitor, metric or test conditions behind them. The practical value of the launch rests less on those superlatives than on whether PQC and AI inference traffic can be exercised together at realistic scale.

    Post-Quantum Encryption Is a Performance Question, Not Just a Security One

    Post-quantum cryptography replaces the mathematical methods that protect today’s encrypted connections with algorithms designed to resist future quantum computers. The US standards body NIST published its first post-quantum standards in 2024, and the pressure to adopt them comes partly from the risk that adversaries are recording encrypted traffic now in order to decrypt it later. The trade-off is that post-quantum key exchanges use considerably larger keys than the methods they replace, which means more data and more computation each time an encrypted TLS session is set up. TLS is the protocol behind the padlock in a browser and behind most API traffic.

    That cost does not fall evenly. It lands on the devices that terminate or inspect encryption at scale: next-generation firewalls, secure web gateways, load balancers and the Zero Trust architectures (security designs that verify every connection rather than trusting anything inside the network perimeter) that VIAVI’s announcement names. AI inference traffic runs through exactly this equipment. A user query to an LLM-powered service is typically an encrypted request that passes security controls before it reaches the model and after the answer comes back, and inference services are judged heavily on responsiveness. Any added handshake overhead or reduced connection capacity shows up directly as latency or as a need for more security hardware.

    This is where the CF50 changes the workflow. VIAVI says the appliance generates encrypted and mixed application traffic up to 100G with native PQC support, and separately offers AI inference and LLM testing. For the network equipment makers, integrators and service providers VIAVI is targeting, that means the performance impact of switching a firewall or gateway to post-quantum TLS can be measured against realistic application and AI traffic in the lab, before deployment. The overhead becomes a number that goes into sizing and procurement decisions rather than a surprise in production. How fully that promise holds depends on whether both traffic types can run in the same test, which VIAVI’s announcement implies but does not spell out.

    What the 1.75X and Lowest-Power Claims Do and Do Not Establish

    VIAVI states that the CF50’s TLS performance is 1.75 times that of the nearest competitor and that it has the industry’s lowest power consumption. Both claims are plausible marketing for a product in a competitive test-and-measurement category, and both are unverified. The company has not named the competitor or product compared, specified whether the metric is new connections per second, concurrent sessions or encrypted throughput, stated whether the comparison used classical or post-quantum cipher suites, or published a wattage figure.

    Those distinctions matter to buyers. A tester that leads on encrypted throughput may not lead on handshake rate, and handshake rate is where post-quantum overhead concentrates. A power figure matters for labs with constrained rack power, but lowest-in-class means little without knowing the class. The quote from Mauricio Sanchez of Dell’Oro Group supports the general case for realistic pre-deployment testing of AI and encrypted workloads. It does not address the CF50’s specific performance figures, and readers should not treat it as independent validation of them.

    A Smaller Box Widens Who Can Afford This Kind of Testing

    High-scale encrypted traffic testing has traditionally required large chassis systems and specialist operators. The CF50 packs the capability into 1U, a single standard rack slot about 1.75 inches tall, and replaces a Windows desktop client with a web interface. VIAVI also includes automated goal-seeking, which ramps load until a device under test reaches its limit, MITRE ATT&CK frameworks, a public catalog of real-world attacker techniques used to check whether security controls detect them, and repeatable traffic-mix testing.

    The commercial logic is to extend enterprise-scale testing below the tier served by the CF1000 to smaller equipment vendors and integrators. If the portability and price hold up, more of the security and networking supply chain can test post-quantum and AI-traffic performance in-house rather than relying on vendor datasheets. VIAVI has not disclosed pricing, so the cost-effectiveness claim, like the performance claims, awaits specifics.

    Background

    VIAVI Solutions, based in Chandler, Arizona, is a test-and-measurement and optical technology company. Its test products are used to validate data center, communications network and security infrastructure, and it also supplies resilient positioning, navigation and timing systems for military, aerospace, railway and first-responder communications, alongside optical technologies for anti-counterfeiting, consumer electronics and automotive markets.

    CyberFlood is VIAVI’s line of application and security test platforms, which emulate large numbers of users and applications to measure how networks and security devices perform. Before the CF50, the line’s flagship was the CF1000 for large enterprises. The new model arrives as organizations move AI inference into production and begin preparing encrypted connections for the transition to post-quantum cryptography.

    Sources

    Source: VIAVI Announces Smallest, Lightest, Most Efficient Platform for 100G Enterprise-Scale Application, Security and AI Inference Testing, VIAVI Solutions’ September 29, 2026 announcement of the CyberFlood CF50 test appliance.

  • Everyone’s Watching New AI Silicon. CoreWeave Found 19.8% in Racks It Already Had.

    Everyone’s Watching New AI Silicon. CoreWeave Found 19.8% in Racks It Already Had.

    TL;DR · 30-second read

    The Short Version

    CoreWeave rents out computers that run artificial intelligence. On September 16 it published results from an independent industry test and said its machines handled AI requests faster than those of rival rental companies.

    The more interesting result is quieter: on machines it installed months ago, it got about 20 percent more work out of each chip purely by improving its own software. No new hardware.

    That matters because those chips cost a fortune. Squeezing more out of the ones you own, instead of buying more, is where the profit in this business actually sits.

    CoreWeave on September 16, 2026 published its submissions to MLPerf Inference v6.1, the industry benchmark round released the same day by MLCommons. Writing on the company blog, Shadi Saba said CoreWeave entered the Datacenter Closed division’s Available category across four NVIDIA platforms — HGX B200, HGX B300, GB200 NVL72 and GB300 NVL72 — and four model families: Qwen3-VL-235B-A22B, DeepSeek-R1-671B, GPT-OSS-120B and Llama 2 70B. Headline figures include 16,635 tokens per second per GPU on GPT-OSS-120B in the offline scenario, more than 1.19 million tokens per second from a single GB300 NVL72 rack, and 944,902 tokens per second on Llama 2 70B in the server scenario. NVIDIA, in a blog post of its own, announced that its next-generation Vera Rubin NVL72 made its MLPerf debut in the same round.

    One day later, on September 17, CoreWeave filed an 8-K disclosing a proposed $3.0 billion offering of convertible senior notes due 2033, with an option for a further $500 million, alongside an Equity Distribution Agreement covering at-the-market share sales and collared forward sales through eleven banks. The two disclosures, a day apart, describe the same business from opposite ends: what the fleet produces, and what it costs to keep building.

    Executive Summary

    CoreWeave’s MLPerf claims break into two categories, and they are not equally interesting. The absolute throughput records — 1,196 queries per second on the multimodal Qwen3-VL model, over 1.16 million tokens per second on GPT-OSS-120B from one rack — are a function of running NVIDIA’s newest shipping silicon, GB300 NVL72, at scale. Any operator with the same racks and the same power envelope is in that fight.

    The second category is harder to replicate. CoreWeave says that comparing its 72-GPU v6.1 submission against its 64-GPU v6.0 submission on GB200 NVL72, derived per-GPU server throughput on DeepSeek-R1-671B rose 19.8% in the five months between rounds. That gain came from serving-stack tuning, scheduling and operations, not from a new chip. If it holds in production, it changes the revenue a depreciating asset can generate across its life — which is the number that underwrites everything else.

    That includes the financing. The 8-K filed September 17 shows CoreWeave raising $3.0 billion in converts on top of an existing stack of senior notes carrying coupons from 8.500% to 9.750%. Capital that expensive is serviced by output per installed accelerator, and software gains on hardware already paid for are the cheapest output there is.

    The 19.8% That Didn’t Require a New Chip

    Strip the benchmark round down and one number does real work. CoreWeave reports that its DeepSeek-R1-671B per-GPU server throughput on NVIDIA GB200 NVL72 rose 19.8% between MLPerf Inference v6.0 and v6.1 — five months apart — through changes to its serving stack, scheduling and operations rather than new hardware. The mechanisms it names are specific: topology-aware scheduling through SUNK, which pins an inference workload inside a single high-bandwidth NVLink domain so that tokens moving between accelerators never leave the fastest interconnect in the rack, and fleet-level health monitoring through Mission Control. For a mixture-of-experts model like DeepSeek-R1 — an architecture that routes each token through a subset of specialised sub-networks, so traffic between chips is constant — placement is not a detail. It is the workload.

    Who this affects is everyone financing GPUs on a multi-year schedule. An accelerator bought in early 2026 has a fixed capital cost and a depreciation clock that does not care how efficiently it runs. If per-GPU output rises roughly a fifth without capex, the cost per token served falls by a comparable amount across the remaining life of that asset, and the residual economics of the installed base improve rather than decay. That is a materially different asset story from the one where value arrives only with the next generation of silicon.

    The claim deserves its caveats stated plainly, and CoreWeave states some of them itself. Per-GPU throughput is a derived metric — total system throughput divided by accelerator count — and the company notes it is not verified by MLCommons. The comparison also spans two differently sized submissions, 64 accelerators in v6.0 against 72 in v6.1, so scaling behaviour and configuration changes are folded into the same percentage as the software work. The direction is credible and the mechanism is named; the precision of the figure is CoreWeave’s own arithmetic, not the benchmark’s finding.

    The Unit of Account Moved From the Chip to the Rack

    The GB300 NVL72 is not a server. It is a rack in which 72 accelerators share one NVLink domain, meaning they address each other at memory-like speeds rather than over conventional networking. CoreWeave’s results read accordingly: over 1.16 million tokens per second in the server scenario and over 1.19 million offline on GPT-OSS-120B from a single rack, 944,902 and 1,136,100 tokens per second on Llama 2 70B, and 1,196 queries per second on Qwen3-VL-235B-A22B. The company’s GB200 NVL72 submission reached 901,058 tokens per second on GPT-OSS-120B in the server scenario — the same architecture, one generation back, and a visible step down.

    The consequence lands on the people who build and power facilities rather than the people who buy models. When the smallest sensible deployment unit is a rack drawing far more than a legacy hall was designed for, throughput per rack becomes a proxy for how much revenue a given square metre and a given megawatt can carry. Operators comparing a rack-scale NVL72 deployment against clusters of HGX B200 or B300 servers — which CoreWeave also submitted, and which it says led all HGX entries from cloud providers — are really comparing two different power-density and liquid-cooling commitments, not two spec sheets.

    Available Is the Word Doing the Most Work

    CoreWeave’s submissions sit in the Datacenter Closed division’s Available category. Closed means every entrant runs the same reference implementation, so results are comparable rather than a contest in custom optimisation; Available means the system can actually be obtained. That second qualifier matters this round, because NVIDIA used the same release to announce that its next-generation Vera Rubin NVL72 made its MLPerf debut. A benchmark headline generated by a platform that is debuting is not a price a buyer can procure against today; CoreWeave’s four platforms are all Blackwell and Blackwell Ultra, the generations in production now.

    For anyone running a procurement process, the practical read is to check three fields before treating any v6.1 result as a quote: which silicon generation produced it, whether the entry sits in the Available category, and whether the metric quoted is a submitted number or a derived per-GPU figure. CoreWeave also stresses that it ran on the same production clusters and images customers get rather than a benchmark-tuned rig — a genuinely meaningful distinction, though one the benchmark itself does not audit.

    Throughput Is the Collateral Story

    The day after the benchmark post, CoreWeave’s 8-K disclosed a proposed $3.0 billion offering of convertible senior notes due April 1, 2033, sold under Rule 144A to qualified institutional buyers, with an option for up to $500 million more and capped call transactions to limit dilution on conversion. A concurrent Equity Distribution Agreement adds at-the-market share sales and collared forward sales through a syndicate that includes Deutsche Bank, Goldman Sachs, J.P. Morgan, Morgan Stanley and Citigroup. Interest and conversion terms, the release states, are set at pricing.

    The comparison worth making is internal. CoreWeave’s own press release lists the existing obligations the new notes will rank alongside: senior notes at 9.250%, 9.000%, 9.750%, 9.625% and 8.500%, and earlier convertibles at 1.75%. Converts price far below straight debt because the buyer is paid partly in equity optionality rather than cash coupon — cheaper carry now, potential dilution later, which the capped calls are bought to blunt. For a business whose costs are dominated by accelerators, the servicing capacity for any of it comes back to tokens per installed GPU.

    That is the honest link between two documents filed a day apart, and it is a structural one rather than a causal one: a benchmark result is a performance claim, not a revenue disclosure, and nothing in the filings ties the offering to the MLPerf round. But the neocloud model runs on both halves at once — demonstrable output per accelerator to justify the capital, and access to capital to buy more accelerators. Software gains of the kind CoreWeave reported on already-deployed GB200 racks are the half that does not require either.

    Background

    CoreWeave, based in Livingston, New Jersey and listed on Nasdaq as CRWV, is a specialist cloud provider built around NVIDIA accelerators for AI training and inference — a category often called a “neocloud,” distinguished from general-purpose hyperscalers by its narrow focus and its heavy reliance on debt and equity markets to fund hardware. The company was recently named a Visionary in the Gartner Magic Quadrant for Cloud AI Infrastructure.

    MLPerf, administered by the MLCommons consortium, has become the closest thing the industry has to an audited comparison of AI serving performance, which is why vendors submit and why the categories matter. Inference — running a trained model to answer requests — is now the larger and more cost-sensitive half of the AI workload, because a model is trained once but served continuously. That shift is what makes tokens per accelerator, rather than raw chip specifications, the metric operators and their lenders increasingly watch.

    Sources

    Source: MLPerf® Inference v6.1 Results: CoreWeave Leads Providers — CoreWeave’s September 16, 2026 post detailing its Datacenter Closed, Available submissions across four NVIDIA Blackwell platforms. See also NVIDIA Vera Rubin NVL72 Delivers Leading Performance in MLPerf Inference v6.1 Debut, NVIDIA’s account of the same benchmark round.

    Primary sources: CoreWeave, Inc. Form 8-K filed September 17, 2026 (Items 7.01 and 8.01, disclosing the proposed convertible notes offering and the Equity Distribution Agreement); Exhibit 99.1 — CoreWeave Announces Proposed $3.0 Billion Convertible Senior Notes Offering; and Exhibit 99.2 — CoreWeave Investor Presentation, September 2026. Full benchmark tables are published by MLCommons at mlcommons.org.

  • FuriosaAI Brings Inference Servers to Equinix Lisbon for Sovereign AI

    FuriosaAI Brings Inference Servers to Equinix Lisbon for Sovereign AI

    TL;DR · 30-second read

    The Short Version

    A South Korean company called FuriosaAI, which designs computer chips for running artificial intelligence, has installed its equipment in a large rented data center in Lisbon, Portugal.

    Almost all artificial intelligence today runs on chips from one American company, Nvidia. FuriosaAI wants to offer European businesses and governments another option, one that keeps their data physically inside Europe.

    If challengers like this gain ground, Europeans could get more choice over who powers their artificial intelligence and where their information lives.

    BigGo Finance reported that FuriosaAI, a Seoul-based designer of AI accelerator chips, has deployed inference servers at an Equinix data center in Lisbon, Portugal. The company is targeting Europe’s sovereign AI market: organizations that want AI workloads to run on infrastructure located, and legally governed, inside Europe.

    No deployment size, power capacity, customer names, launch date or commercial terms have been made public.

    Executive Summary

    FuriosaAI is placing its own inference hardware inside Equinix, one of the world’s largest colocation providers. Inference is the everyday work of running a trained AI model to answer questions or generate text, as opposed to training the model in the first place. Colocation means renting space, power and network connections in a shared data center rather than building one.

    The move matters because it follows a pattern: chip challengers to Nvidia are using neutral, well-connected colocation sites as showrooms and on-ramps to regional markets. For European buyers weighing data residency rules and concerns about dependence on a single supplier, a locally hosted non-Nvidia option is worth watching. How significant this particular deployment is depends on details the companies have not yet disclosed.

    Inference Is Where Challengers Can Compete

    Training frontier AI models remains overwhelmingly an Nvidia business, anchored by its CUDA software ecosystem and years of developer familiarity. Inference is a different contest. Once a model is trained, operators care most about cost per query, latency and electricity use, and those metrics give specialized chips room to argue their case. FuriosaAI’s pitch, like that of several rivals, centers on running popular open models efficiently rather than matching Nvidia across every workload.

    The economics favor that focus. Inference demand grows with every deployed chatbot, search feature and enterprise assistant, and it runs continuously rather than in one-off training runs. A chip that meaningfully lowers power per query can matter more to a data center operator’s bills than raw peak performance. Whether FuriosaAI’s hardware delivers that advantage at production scale is the claim buyers will want to verify with their own models.

    Colocation as a Market-Entry Shortcut

    For a hardware startup, building data centers across Europe is out of reach. Placing servers in an Equinix facility provides immediate access to power, cooling, security and, crucially, direct network connections to the enterprises, cloud providers and carriers already housed there. Prospective customers can test the hardware with low latency, without shipping equipment to their own sites or committing to a new cloud vendor.

    Equinix benefits too. Colocation providers increasingly compete on the ecosystems they host, and a range of accelerator options gives tenants reasons to stay and expand. Chips marketed on power efficiency may also fit more easily into existing data halls than the densest GPU clusters, which increasingly require liquid cooling retrofits. That is a practical advantage if it holds, though no power or rack-density figures have been published for this deployment.

    What Sovereign AI Actually Means Here

    Sovereign AI has become a broad label covering data residency, legal jurisdiction, operational control and supply-chain independence. European demand is real, shaped by GDPR, the EU AI Act and public-sector reluctance to depend entirely on US platforms. A deployment on Portuguese soil addresses the first of those concerns: data can stay in the EU.

    The other dimensions are less clear-cut. The chips come from a South Korean designer, the facility is operated by a US-headquartered company, and advanced chip manufacturing remains concentrated in Asia. None of that disqualifies the offering, since few AI stacks anywhere are fully domestic, but buyers should ask which layer of sovereignty is being delivered. Diversifying away from a single dominant chip supplier is itself a form of resilience that some European buyers value, regardless of where that supplier is based.

    Why Lisbon, and What It Signals

    Lisbon is not one of Europe’s traditional data center hubs of Frankfurt, London, Amsterdam, Paris and Dublin, where power and land constraints have tightened. Portugal offers a strong renewable electricity mix and sits at a landing point for subsea cables linking Europe with Africa, the Americas and beyond. For AI inference, which benefits from proximity to users but not necessarily to the largest hubs, secondary markets with available power are increasingly attractive.

    The choice may also reflect pragmatism: a smaller market can offer faster access to capacity and a less crowded field. The trade-off is a thinner local customer base than in the core hubs, so the deployment’s commercial value will depend on whether it serves as a pan-European access point or mainly a regional one.

    Background

    FuriosaAI was founded in Seoul in 2017 to design dedicated AI accelerators. It is one of a cohort of chip startups trying to capture part of the fast-growing inference market, where efficiency and cost can matter more than the raw training performance that made Nvidia dominant. Its current product line centers on its RNGD inference chip, marketed for running large language models with lower power consumption.

    Equinix is among the largest colocation and interconnection providers globally, operating data centers across dozens of metropolitan areas. Its facilities are valued less for floor space than for the density of networks, clouds and enterprises connected inside them. In Europe, demand for sovereign AI, meaning AI infrastructure kept within European jurisdiction, has grown alongside regulation and concerns about dependence on non-European technology providers.

    Sources

    Source: FuriosaAI Deploys Inference Servers at Equinix Lisbon Data Center, Targeting Europe’s Sovereign AI Market, BigGo Finance’s report on FuriosaAI’s Lisbon inference deployment.

  • Nebius–Palantir Deal: A Neocloud Moves Inside the Software Perimeter

    Nebius–Palantir Deal: A Neocloud Moves Inside the Software Perimeter

    TL;DR · 30-second read

    The Short Version

    Palantir, a company that sells data-analysis software to large organizations, has picked Nebius, a company that rents out powerful computers for artificial intelligence, as its preferred partner for running that work.

    The pitch: businesses can train their own artificial intelligence on their own private data, using machines they control, instead of handing that data to a big tech provider.

    Nebius’s stock jumped on the news. Neither company has said how much money is involved or exactly when it starts.

    On September 8, 2026, Palantir Technologies and Nebius Group announced a strategic partnership under which Palantir named Nebius its preferred sovereign AI infrastructure partner. According to the joint press release, which Nebius furnished to the SEC in a Form 6-K the same day, Palantir will bring Nebius compute and inference endpoints inside the Palantir enterprise perimeter after an integration period. Eligible Palantir commercial customers will then be able to run and adapt open AI models on Nebius infrastructure. The companies also said they will work together to deploy new compute capacity for Palantir customers, including modular data centers at sites where power is already available.

    Seeking Alpha reported that Nebius shares rose about 8% following the announcement, bringing their year-to-date gain to roughly 175%. Neither company disclosed financial terms, capacity commitments, or a timeline.

    Executive Summary

    The Nebius–Palantir partnership pairs a neocloud with an enterprise software platform. A neocloud is a newer cloud provider built mainly to rent out GPU capacity for AI. The deal gives Nebius something pure infrastructure providers often lack: a direct channel into large commercial organizations that already run Palantir’s Foundry and AIP software. For Palantir, it adds a named compute layer to what it calls its Sovereign AI Operating System. That system is pitched to customers who want to train models on proprietary data without giving up control of the data, the models, or the hardware they run on.

    The announcement matters because it tests a central question for GPU capacity providers: can they move beyond selling compute by the hour and capture a share of the higher-margin software relationship? The release answers only part of that question. Nebius gains preferred status and placement inside Palantir’s environment. Palantir, however, keeps the authorization, isolation, and data layer, which is the part customers interact with day to day. How revenue is split, and how much capacity is involved, has not been disclosed.

    Distribution, Not Just Capacity

    Most neoclouds compete on how quickly they can bring GPUs online and how cheaply they can rent them. That is a hard business to differentiate. Hardware is largely sourced from the same supplier, and large AI labs negotiate aggressively on price. The Palantir arrangement gives Nebius a different kind of asset: placement inside a software platform that enterprise buyers have already approved, integrated, and budgeted for. In enterprise IT, getting onto an approved-vendor list can take longer than building a data center. Being embedded in a platform the customer already trusts shortens that path considerably.

    The joint release frames Palantir’s choice around Nebius being built for AI from the ground up, with infrastructure and software designed together, rather than adapted from general-purpose computing. That claim reflects how the partners describe their choice. It is not an independent benchmark. It does, however, match the positioning neoclouds have used against the large hyperscalers (Amazon Web Services, Microsoft Azure, Google Cloud), whose AI offerings sit alongside broad general-purpose cloud businesses.

    Who Captures the Software Value?

    The editorial question is whether this deal moves Nebius up the stack. The honest answer is: partially. Under the announced structure, Palantir’s AIP, Ontology, Foundry, and Apollo provide what the release calls the authorization and isolation layer. That is the governance and data-modeling software that decides who can see what and how models are applied to business operations. Nebius supplies the compute and inference endpoints underneath. Inference endpoints are the services that run a trained model and return its answers. In that arrangement, Palantir owns the customer-facing software relationship, and Nebius becomes a preferred engine inside it.

    That still has value for Nebius. Inference is recurring, usage-driven demand. It tends to be more durable than one-off training runs, and enterprise customers who fine-tune open models on their own data will need to keep running them. But the term used is “preferred,” not “exclusive.” Nothing in the release prevents Palantir from adding other infrastructure partners later. The release also does not indicate whether Nebius bills customers directly or is paid through Palantir. That distinction largely determines how much of the economics Nebius actually captures.

    Sovereignty as a Commercial Product

    “Sovereign AI” has typically meant national governments wanting AI infrastructure under domestic control. This announcement applies the idea to companies instead. The release describes offering commercial organizations that have not previously had a sovereign option a way to run their own models on trusted infrastructure. In practice, that means an enterprise can take an open model, whose weights are publicly available, adapt it with proprietary data, and keep both the data and the resulting model. The alternative is sending that data to a closed model hosted by a third party.

    The release explicitly targets Palantir’s commercial customers. It does not mention government or defense workloads, even though Palantir has deep roots in government. Any expansion into public-sector use would likely require separate security accreditations. Palantir CEO Alex Karp said Palantir’s ontology and Nebius’s infrastructure “will undergird the sovereignty our partners are demanding.” Nebius CEO Arkady Volozh said organizations need “both the performance of large-scale AI infrastructure and control over their data and models.” The release also claims that domain-adapted open models can outperform general-purpose closed models for specific uses. That is plausible for narrow tasks, but it is an assertion rather than a demonstrated result.

    Modular Builds and the Power Question

    The most operationally concrete line in the announcement concerns speed to capacity. The companies said they will use modular data-center deployments at sites where power is already available. Modular data centers are prefabricated units that can be installed far faster than a conventional purpose-built facility. The emphasis on existing power reflects a constraint across the industry: grid connections for large new loads can take years to secure. Sites with power already in place are among the scarcest assets in AI infrastructure.

    This approach reduces some risks and introduces others. Modular deployments can serve customers faster, but they are typically smaller than campus-scale builds. They also depend on securing GPUs, cooling, and network connectivity at each location. The release names no sites, megawatt figures, or deployment schedule. Until those details appear, the capacity commitment is best read as a stated intention, not a quantified plan.

    Background

    Nebius Group N.V. is an Amsterdam-headquartered AI cloud company listed on Nasdaq under the ticker NBIS. It emerged from the 2024 restructuring of Yandex N.V. after that company divested its Russia-based businesses. Founder and CEO Arkady Volozh co-founded Yandex. Nebius describes itself as building a full-stack platform for AI development, from data and model training to production deployment. It is part of the neocloud cohort of GPU-focused providers that has grown rapidly alongside demand for AI compute. As a foreign private issuer, it reports material events to the SEC on Form 6-K.

    Palantir Technologies, listed on Nasdaq as PLTR, built its reputation on data-integration software for government and defense agencies and has since expanded into commercial markets. Its Foundry, Ontology, Apollo, and AIP products let organizations model their operations, manage data access, and apply AI to business workflows. The Nebius partnership extends that software into a named compute layer that Palantir markets as sovereign AI.

    Sources

    Source: Nebius And Palantir: Implications Of The New Partnership (NASDAQ:NBIS) — Seeking Alpha, analysis of the Nebius–Palantir AI infrastructure partnership and the market reaction.

    Primary sources: Nebius Group N.V. Form 6-K filed September 8, 2026 (SEC EDGAR); Exhibit 99.1: Palantir and Nebius partner to deliver a complete sovereign AI stack to Palantir customers (September 8, 2026).

  • DOJ Probes Nvidia’s Groq Licensing Deal: A Merger Review Test

    DOJ Probes Nvidia’s Groq Licensing Deal: A Merger Review Test

    TL;DR · 30-second read

    The Short Version

    Nvidia makes the chips that most artificial intelligence runs on. Groq is a small company building a rival chip.

    Rather than buy Groq, Nvidia paid to license its technology. The United States Justice Department, which enforces competition law, is examining whether that was a way to defuse a competitor while sidestepping the government review a takeover would have triggered. The New York Times reported the inquiry.

    Fewer chipmakers competing usually means higher prices for everyone building artificial intelligence. Nothing has been decided, and an investigation is not an accusation.

    The New York Times reported that the U.S. Department of Justice is investigating Nvidia’s licensing agreement with Groq, a startup that designs processors specialized for AI inference. Reuters carried the report. The reported inquiry centers on a transaction structured as a technology license rather than an outright purchase of the company.

    Separately and on the record, Nvidia disclosed in a Form 8-K filed September 3, 2026 that it had entered into a definitive agreement the previous day to acquire Hugging Face, Inc. for a purchase price of approximately $11.9 billion payable to Hugging Face stockholders, plus an equity-based retention program of up to approximately $1.0 billion for employees joining Nvidia. That deal is expected to close in the first half of 2027, subject to customary closing conditions including required regulatory approvals.

    Executive Summary

    At issue is a structural question that has been building across the AI industry for two years: whether a large incumbent can obtain the competitively significant parts of a rival, its designs, its engineers, or its roadmap, through a licensing agreement, and thereby avoid the premerger notification and waiting period that a purchase of the same company would require.

    The answer under U.S. law is not a simple yes. Premerger notification obligations can attach to exclusive licenses that transfer the commercially significant rights in a technology, and the antitrust laws reach transactions whether or not they were ever reportable. An investigation is the government asking whether the substance of an arrangement matches its form. It is not a finding that anything is wrong.

    For the infrastructure market, the stakes are concrete. Inference, the work of actually running a trained model, is the fastest-growing slice of accelerator demand and the part of the stack where Nvidia faces the most credible specialist competition. Every viable alternative silicon vendor is a pricing lever, a supply hedge, and a power-efficiency variable for the operators building AI capacity. What happens to those alternatives is a procurement question, not just a legal one.

    A License Is Not Automatically Outside Merger Review

    The Hart-Scott-Rodino Act requires companies to notify the antitrust agencies before completing acquisitions of voting securities or assets above a size threshold, then wait while the government looks. The intuition that a license escapes this is only half right. Where a license is exclusive and hands over all commercially significant rights to a technology in a defined field, the agencies have long treated it as an asset acquisition, an approach worked out most thoroughly in pharmaceutical licensing. Form does not settle the question; the scope of what moved does.

    The second point matters more. Section 7 of the Clayton Act reaches acquisitions of assets whose effect may be substantially to lessen competition, without regard to whether anyone was obliged to file. Sections 1 and 2 of the Sherman Act reach agreements and monopoly-maintenance conduct on their own terms. Deals that were never notifiable have been investigated and unwound after closing. Avoiding a filing obligation, if that is what happened, buys quiet, not immunity.

    So the useful framing is not whether Nvidia and Groq had to file. It is whether the arrangement transferred enough of Groq’s competitive significance that the market lost a constraint on Nvidia. That is a factual inquiry into exclusivity, field-of-use limits, personnel, and whether Groq retains the freedom and the resources to keep selling against the company that licensed it.

    Inference Is Where Nvidia’s Position Is Most Contestable

    Training a large model is a one-off capital event: enormous clusters, months of runtime, tolerance for cost. Inference is the opposite. It is the same model answering a query billions of times, where cost per token, latency, and energy per token decide whether a product has a business model. Groq’s proposition has been purpose-built silicon aimed at deterministic, low-latency token generation rather than general-purpose graphics processors adapted to the job.

    That distinction is why inference has attracted specialist entrants when training largely has not. It is also why data center operators care. A second credible inference vendor changes the terms of a Nvidia negotiation, hedges against allocation risk in a supply-constrained market, and offers a different power and rack-density profile at a moment when megawatts, not dollars, are the binding constraint on new AI capacity.

    The harm theory a licensing structure has to answer follows directly. A startup can remain in business, keep its name on the door, and still stop functioning as a competitive constraint if its roadmap, its patents, or its senior engineering talent now sit inside the incumbent. Option value for buyers can fall to near zero without a single share changing hands. Whether that describes this arrangement is precisely what has not been established publicly.

    Nvidia’s Own Filing Shows What the Reviewed Path Looks Like

    The Hugging Face agreement is instructive as a contrast, and in fairness to Nvidia, it cuts against any blanket claim that the company routes around oversight. In its September 3 filing, Nvidia disclosed the counterparty, a purchase price of roughly $11.9 billion, a retention pool of up to roughly $1.0 billion, an expected close in the first half of 2027, and an explicit condition that required regulatory approvals be obtained. Everything a reviewing agency would want to start with is on the public record.

    The filing goes further. Nvidia stated a commitment to keep the Hugging Face platform open, to continue permitting model makers, developers, and users to upload and download models and datasets of their choosing, and, notably, to support other silicon vendors. That last phrase is a behavioral commitment aimed squarely at the foreclosure concern a reviewer would raise about a chip company acquiring the distribution layer for open models. Making it in an 8-K, before review, is a deliberate choice.

    Set the two structures side by side. One produces a disclosed price, a regulatory condition, and written commitments a government can point to later. The other, as reported, produces none of that in public view. The reported inquiry is best read as a test of whether the second can deliver acquisition-like effects with materially less scrutiny, and the answer will shape how the next dozen AI deals are papered.

    An Investigation Is Not a Case

    Most antitrust investigations close without a complaint. The Justice Department’s usual tools at this stage are civil investigative demands for documents and testimony, and the process commonly runs many months. To bring a case, the government would need to define a relevant market, establish that Groq was an actual or nascent competitive constraint on Nvidia, and show the agreement materially reduced it. Each of those is contestable, and the nascent-competition theory in particular has a mixed record in court.

    Nvidia has real arguments available. Licensing can expand output rather than restrict it, non-exclusive terms spread a technology further than a single firm could, and a startup with a licensing revenue stream may compete harder, not less. None of this is settled by the existence of an inquiry, and it would be wrong to read one as a verdict.

    The practical guidance is unglamorous. Infrastructure buyers should not rewrite procurement plans around a reported probe, but should ask vendors directly about roadmap independence and multi-year supply commitments, which is a sensible question regardless. Investors watching Nvidia have a cleaner signal available in the Hugging Face timetable: how that review proceeds through 2027 will say more about the agencies’ posture toward the company than any single report about an earlier deal.

    Background

    Nvidia sits at the center of AI infrastructure because of a combination of graphics processors and the CUDA software layer that most machine learning frameworks were built against. That software gravity is why competitors have found it easier to attack inference, where workloads are narrower and more repetitive, than to attack training. Groq is one of a small group of companies that designed silicon specifically for fast, low-latency inference rather than adapting a general-purpose part to the task.

    The transaction structure at issue is not unique to Nvidia. Since 2024, several of the largest AI companies have obtained technology licenses from smaller developers while hiring substantial portions of their teams, leaving the startup nominally independent. Competition authorities in the United States and the United Kingdom have examined more than one of these arrangements to determine whether they amount to acquisitions in substance. The reported Groq inquiry extends that question from model developers to chip designers, where the competitive stakes for buyers of AI capacity are more immediate.

    Sources

    Source: DOJ probes Nvidia’s licensing deal with AI startup Groq, NYT reports — Reuters coverage of a New York Times report that the Justice Department is examining the Nvidia-Groq licensing arrangement. See also Justice Dept. Investigates Nvidia Deal With Groq — The New York Times.

    Primary sources: NVIDIA Corporation, Form 8-K filed September 3, 2026 — Item 8.01 disclosure of the definitive agreement to acquire Hugging Face, Inc., including the approximately $11.9 billion purchase price, the retention program of up to approximately $1.0 billion, the expected first-half 2027 close subject to required regulatory approvals, and Nvidia’s commitment to keep the platform open and support other silicon vendors.

  • Equinix Bets Interconnection Is AI’s Real Choke Point

    Equinix Bets Interconnection Is AI’s Real Choke Point

    TL;DR · 30-second read

    The Short Version

    The scarce ingredient in artificial intelligence may not turn out to be powerful chips. It may be the wiring.

    Equinix runs the buildings where networks, cloud providers and companies physically plug into one another. It has announced a service built for the moment an artificial intelligence program answers a question, rather than the months it spends learning — and has attached early quantum computing to the same offering.

    Fast answers need computers close to the people asking. Equinix is betting that the connection points it already owns, not sheer computing horsepower, become the thing everyone competes for.

    Simply Wall St reported that Equinix has introduced an AI and quantum inference fabric, a productised way for customers to run inference workloads — the stage at which a trained model actually answers queries — across the company’s interconnection footprint, with quantum computing named alongside it. Yahoo Finance separately framed the move as Equinix doubling down on AI data centers, and posed it as a question for holders of EQIX, the company’s Nasdaq-listed shares.

    Equinix has not published capacity figures, launch metros, pricing, availability dates or named customers for the offering. What is on the record at this stage is the strategic direction and the product name, not the commercial scale behind either.

    Executive Summary

    The announcement matters less for what it adds to Equinix’s estate than for where it points. Almost every headline in AI infrastructure over the past two years has been about training capacity: gigawatt campuses, accelerator supply, power procurement in remote counties where electricity is cheap and land is plentiful. An inference fabric is an argument that the next constraint sits somewhere else entirely — in dense, network-rich metro facilities where the distance between a model and its user is measured in milliseconds rather than megawatts.

    That argument plays to Equinix’s structural strength. The company’s durable advantage has never been raw square footage; it has been the density of networks, clouds and enterprises inside the same buildings, and the cross-connects between them. If inference does migrate toward metro edges, interconnection-rich colocation becomes a choke point that is genuinely difficult to replicate, because it is built from accumulated tenancy rather than capital alone.

    The caution is that a strategic thesis and a revenue line are different things. Bundling quantum into an inference product is a forward-looking positioning move, and the offering has been described without the contracted capacity, customer names or economics that would let buyers or investors size it. The thesis is credible; the evidence that it is already converting into demand has not yet been put on the table.

    Inference Rewrites the Map That Training Drew

    Training a large model is a batch job. It can happen anywhere the power is cheap and abundant, because nobody is waiting on the other end of the wire. Inference is the opposite: it is a live transaction, and every network hop between the user and the model shows up as lag. That single difference pulls compute back toward population centres, toward the metro facilities where carriers, cloud on-ramps and enterprise networks already terminate — precisely the sites carrier-neutral colocation providers have spent decades assembling.

    This is why an inference-oriented fabric is a more interesting signal than another announcement of remote megawatts. It implies a view that AI capacity will bifurcate: enormous, power-hungry training campuses in the hinterland, and a distributed layer of smaller, latency-sensitive inference footprints in cities. The second layer is smaller in energy terms but far more valuable per square foot, because what customers are buying is proximity and connectivity rather than bulk.

    For enterprise buyers, the practical consequence is that AI deployment starts to look like a network design problem rather than a procurement problem. Where the model sits relative to the data it consumes, and how many private connections separate the two, determines both response time and egress cost. That is a familiar conversation for anyone who has architected hybrid cloud — which is, not coincidentally, the conversation Equinix is best positioned to have.

    The Choke Point Argument, and Its Limits

    The strongest version of Equinix’s case is that interconnection is a compounding asset. A cross-connect — a physical cable between two tenants in the same facility — is cheap to provision and expensive to leave behind, because the value of being in a building rises with everyone else already in it. Accelerator supply, by contrast, is a commodity that reprices with each hardware generation. If inference genuinely disperses to the metro edge, the party controlling the meeting points captures a toll that does not depreciate on a chip cycle.

    The weaker version is the assumption that no one else can occupy that position. Hyperscalers have been extending their own edge and local-zone footprints for years. Carriers own metro real estate and fibre routes. A cohort of specialist GPU cloud operators is building latency-sensitive capacity of its own, and content delivery networks already run inference at points of presence closer to users than most colocation halls. Interconnection density is a real moat, but it is a moat around a market whose boundaries several well-capitalised competitors are actively redrawing.

    There is also a power question that no product announcement dissolves. Metro data centres are the hardest places to add electrical capacity and the slowest to get through utility interconnection queues — the waiting list for a new grid connection, which in constrained markets can run for years. High-density inference racks draw far more per cabinet than the legacy network gear that defines many urban facilities, and retrofitting for that density involves cooling and electrical work, not just a new commercial wrapper.

    Quantum in the Product Name: Option Value or Optics?

    Pairing quantum with inference is the part of this announcement that deserves the most careful reading, and the fairest way to read it is as positioning rather than deception. Providing network-adjacent access to quantum hardware is a coherent thing for an interconnection operator to do: quantum processors are scarce, physically finicky and best consumed as a remote service, which makes a neutral facility with dense connectivity a sensible place to reach them from. Several operators have hosted quantum systems on exactly that logic.

    What is not established by the product name is any claim about quantum performing inference at commercial scale. Today’s quantum machines are experimental instruments, and the phrase invites a parsing question the company has not resolved in public: whether inference is meant to attach to both AI and quantum, or whether quantum access simply sits alongside an AI inference service under one banner. Those are materially different propositions, and buyers evaluating the offering should ask which one they are being sold.

    Treated as option value, the inclusion is defensible and cheap. Treated as evidence of near-term demand, it is unsupported. The honest assessment is that Equinix has claimed a category label early — a familiar and often rational move in infrastructure — and that the label will be worth something only if hardware partners and workloads eventually arrive behind it.

    What the Stock Framing Tends to Miss

    Equinix is structured as a real estate investment trust, meaning it distributes most of its taxable income to shareholders and therefore funds growth largely from debt and equity issuance rather than retained earnings. That structure shapes how any AI build-out must be judged: the relevant question is not whether AI demand exists, but whether the returns on capital deployed into denser, more power-intensive facilities clear a cost of capital that has risen materially since the last data centre cycle.

    An inference fabric is, in that light, an attractive kind of AI exposure precisely because it is capital-light relative to greenfield gigawatt campuses. Selling connectivity and dense colocation into existing buildings monetises assets already on the balance sheet. But it is also a smaller prize than the training build-out, and describing a product without disclosing contracted capacity or pricing leaves investors unable to distinguish a new revenue engine from a repackaging of services the platform already sells.

    The reasonable posture for both buyers and shareholders is interest without recalibration. The strategic logic — that interconnection becomes scarce as inference decentralises — is sound and consistent with how this company has made money for two decades. Whether this specific offering is the vehicle that captures it is a question the disclosed facts do not yet answer.

    Background

    Equinix was founded in 1998 as a carrier-neutral interconnection business: a place where competing networks could meet on neutral ground and exchange traffic directly, rather than paying an intermediary to carry it. That model expanded into a global platform of colocation facilities in which internet exchanges, cloud on-ramps and enterprise infrastructure sit side by side, connected by cross-connects between tenants. The company converted to a real estate investment trust structure in 2015 and trades on the Nasdaq as EQIX.

    The AI build-out has so far favoured a different asset class — very large, power-intensive campuses in locations chosen for cheap electricity and available land, purpose-built for model training. Metro colocation providers have consequently faced a strategic question about where they fit. An inference-oriented offering is one answer: the argument that as models move from being built to being used at scale, the value shifts back toward the network-dense urban facilities that were the industry’s original franchise.

    Sources

    Source: Equinix Is Doubling Down on AI Data Centers. How to Play EQIX Stock Here (Yahoo Finance), on Equinix’s expanding AI data center posture, alongside Should Equinix’s New AI and Quantum Inference Fabric Reshape the Narrative for EQIX Investors? (Simply Wall St), which reported the AI and quantum inference fabric.

  • Equinix Bets Colocation Can Become an AI Inference Utility

    Equinix Bets Colocation Can Become an AI Inference Utility

    TL;DR · 30-second read

    The Short Version

    Equinix rents out the buildings where companies keep their computers and where the world’s networks plug into each other. Now it wants to sell the computing itself.

    With the chipmaker NVIDIA and a startup called Together AI, Equinix has launched a service that runs artificial-intelligence models inside those buildings, close to the businesses using them. The pitch: faster answers, and your data stays where you put it.

    What it costs, how much of it exists, and who has signed up have not been made public.

    Equinix has launched Inference Exchange, a distributed artificial-intelligence inference platform developed with NVIDIA and Together AI, W.Media and Telecompaper reported this week, alongside a new connectivity service. The offering is intended to let enterprises run trained AI models inside Equinix’s metro data centers rather than in a distant public cloud region.

    The companies have not published the platform’s scale. There is no disclosed figure for dedicated capacity, no list of launch metros, no pricing model and no named customers, and Equinix did not accompany the announcement with a material filing to the U.S. Securities and Exchange Commission.

    Executive Summary

    The announcement is a move up the value chain. Equinix’s core business is selling space, power and cross-connects — the physical patch cables that let a bank’s network meet a cloud provider’s network inside the same building. Inference Exchange proposes selling the workload instead: NVIDIA accelerators and Together AI’s serving software, operated in Equinix facilities and reachable over the interconnection fabric its customers already buy.

    The timing tracks the industry’s center of gravity. NVIDIA’s second-quarter fiscal 2027 results, filed with the SEC on August 26, reported revenue of $96.2 billion, up 106% from a year earlier, with data center revenue of $89.0 billion, up 117%. Founder and CEO Jensen Huang framed the quarter around consumption rather than construction: “AI has reached its inflection point. It’s doing useful work. Its tokens are productive and profitable. Now, compute is revenue.” Inference — running models in production — is where that revenue is generated, and unlike training it has to happen near users and near data.

    What matters for buyers and investors is that the strategic logic is clearer than the commercial substance. A partnership among three named companies is real; a contracted, revenue-generating utility is not the same thing, and neither Equinix nor its partners has yet put a number, a date or a customer against it.

    Why Metro Colocation Is the Natural Home for Inference

    Training and inference want different real estate. Training a frontier model is a batch job: it can run anywhere power is cheap and abundant, which is why the largest commitments in the market point at greenfield megasites. NVIDIA’s own CFO commentary describes credit support for roughly 4.25 gigawatts at SB Energy’s PORTS-Pike campus in Ohio — a gigawatt being roughly the output of a large power station — under twenty-year leases to OpenAI. Nobody puts that in a city center.

    Inference is the opposite. It is interactive, it runs continuously, and its latency budget is measured in the tens of milliseconds a user will tolerate before an assistant feels sluggish. It also carries regulatory weight, because the prompts and documents flowing into a model are frequently the customer data a bank or hospital is not permitted to move across a border. Equinix’s asset is precisely metro adjacency plus interconnection density: its facilities are where carriers, clouds and enterprises already meet, so an inference endpoint sited there is a private hop away from a customer’s own network rather than a trip across the public internet.

    The economics of the shift are less settled than the logic. Colocation is a rent business — long leases, predictable yields, capital spent on shells, power and cooling that depreciate over decades. Accelerated computing is not: graphics processing units are expensive, they depreciate fast, and their returns depend on high utilization. Whether Inference Exchange is a capital-intensity story for Equinix or a channel arrangement depends entirely on who buys and owns the hardware, and that has not been stated.

    What NVIDIA’s Record Quarter Says About the Timing

    NVIDIA’s August 26 results give the backdrop unusual clarity. Data center revenue of $89.0 billion grew 117% year over year, and the company guided to $108.0 billion in total revenue for the current quarter while assuming no data center compute revenue from China. The quarter’s own highlights lean hard toward inference: the company said its Groq 3 LPX interactive inference accelerator has entered full production, and disclosed that NVIDIA GPUs with confidential computing are used for confidential inference in Apple’s Private Cloud Compute — a design in which the operator cannot see the data being processed.

    Read together, those signals describe a distribution problem more than a silicon problem. Frontier labs already buy directly and at scale. The next tranche of demand is thousands of enterprises that will never operate a GPU cluster and want inference delivered as a service, in a location they can name, with a contract their compliance team recognizes. Equinix supplies the geography and the enterprise relationships; Together AI supplies the serving layer; NVIDIA supplies the silicon and, critically, keeps those workloads inside its software ecosystem rather than migrating to a rival accelerator.

    The quarter closed on July 26, before this launch, so its silence on Equinix is chronological rather than meaningful. It does, however, set the scale against which the partnership should be read: an arrangement neither party has sized is unlikely to be financially material to NVIDIA in the near term. Its value to NVIDIA is positional. Its value to Equinix, whose revenue base is far smaller than NVIDIA’s data center line, could be proportionally much larger — if it converts.

    Who Gains, Who Gets Squeezed

    Together AI is arguably the clearest beneficiary. An independent AI cloud can win developers on price and model breadth but struggles to reach regulated enterprises that require a named facility, an auditable network path and a counterparty with a balance sheet. Distribution through Equinix’s footprint addresses all three without Together AI building data centers.

    The pressure lands on operators selling undifferentiated GPU hours. If enterprise inference migrates toward venues chosen for latency, data residency and network adjacency, then raw capacity in a remote low-cost region competes on price alone — a difficult position when supply is expanding. Content delivery and edge networking vendors, which have marketed proximity as their advantage, now face a colocation incumbent making the same argument with more power per site. Hyperscale clouds are less exposed: their hold on enterprise inference rests on data gravity, identity systems and developer tooling, none of which a colocation platform replicates. But they are also Equinix tenants, which makes this a partner-adjacent product and raises a channel question Equinix has not addressed publicly.

    Wholesale developers building megawatt campuses are not the losers here. They serve a different workload. The genuine contest is over which layer captures enterprise inference margin — the landlord, the model-serving vendor, or the cloud — and this launch is Equinix’s claim that the landlord can move up rather than be disintermediated.

    What the Launch Substantiates, and What It Doesn’t

    Substantiated: three named companies, a named product, and a second connectivity service announced alongside it. Equinix has the metro sites, the interconnection fabric and the enterprise account base to make the concept credible, and NVIDIA’s disclosed financials confirm that inference demand is real and growing rather than aspirational.

    Not substantiated: everything a buyer would need to price the thing. No capacity figure, no availability date, no commercial model, no customer, no statement of who funds the hardware. That is a common shape for infrastructure platform announcements, where logos typically precede contracted revenue by several quarters, and it is a fair criticism of the disclosure rather than of the strategy.

    One further piece of context deserves attention without overreach. NVIDIA’s filings show an ecosystem in which vendor financial support has become structural: supply commitments rose from $119 billion in the prior quarter to $279 billion; the company disclosed partnerships with Apollo, BlackRock, Blackstone, Brookfield, Goldman Sachs and KKR intended to mobilize over $500 billion of third-party capital over time, subject to definitive agreements; and it reported a maximum gross exposure of $3.5 billion under guarantees for AI cloud partners’ lease obligations, plus the separately capped $105 billion Ohio guarantee. None of that is stated to apply to this partnership. But investors evaluating any NVIDIA-adjacent infrastructure announcement in 2026 are entitled to ask whether hardware is being sold, financed, consigned or revenue-shared — and here, no one has said.

    Background

    Equinix, founded in 1998 and structured as a real estate investment trust since 2015, built its business on carrier-neutral colocation: buildings where any network can connect to any other without favoring an owner’s own transit. That neutrality made its facilities natural meeting points for carriers, cloud providers and enterprises, and interconnection — the cross-connects and virtual links between tenants — became the high-margin core of the model rather than the floor space itself.

    The AI buildout initially looked like a threat to that positioning, because training clusters favor vast, remote, power-rich campuses of a kind Equinix does not principally build. The counter-argument, which this launch embodies, is that once models move into production the workload shifts toward inference, and inference rewards exactly what Equinix already owns: presence in dozens of business metros, dense network adjacency and existing enterprise contracts. NVIDIA’s most recent quarterly disclosures show both halves of that market running at once — gigawatt-scale campus commitments for training on one side, and production-grade inference accelerators and confidential inference deployments on the other.

    Sources

    Source: Equinix launches Inference Exchange in partnership with NVIDIA and Together AI (W.Media) — report of the platform launch by Equinix with NVIDIA and Together AI. Additional coverage: Equinix announces connectivity service and distributed AI inference platform (Telecompaper), Nvidia Taps Equinix, Together AI for AI Inference Push (techbuzz.ai) and How Equinix has found a niche in the multitrillion-dollar AI data center boom (CNBC).

    Primary sources: NVIDIA Form 8-K filed August 26, 2026, reporting results for the quarter ended July 26, 2026; NVIDIA press release, Exhibit 99.1 to the August 26, 2026 Form 8-K, with second-quarter fiscal 2027 revenue, data center results, outlook and product highlights; CFO Commentary on Second Quarter Fiscal 2027 Results, Exhibit 99.2 to the same Form 8-K, detailing supply commitments, data center leases and guarantees; and NVIDIA Form 10-Q for the quarter ended July 26, 2026, filed August 26, 2026.

  • Vectris Claims Up to 73% More AI Throughput From GPUs Already Deployed

    Vectris Claims Up to 73% More AI Throughput From GPUs Already Deployed

    Vectris Labs, a Birmingham, Alabama startup incubated by Thumos Capital, announced on August 20, 2026 that its Waveform software — a “control plane” that sits between AI serving infrastructure and the GPU — recovered substantial unused capacity from GPUs already in production racks. In company-run tests of Mistral inference workloads on RunPod-hosted NVIDIA hardware, Vectris measured 30–73% higher throughput, 51–56% lower energy consumption, and 22–42% faster job completion, with no model retraining, weight changes, or GPU-kernel modifications.

    Waveform launches October 1, 2026 to a limited set of design partners. The results are Vectris-measured and, by the company’s own disclosure, have not yet been independently reproduced in customer production.

    Executive Summary

    The announcement reframes the AI capacity crunch — the industry-wide shortage of GPUs, data-center space, and grid power — as partly a software-efficiency problem. Vectris claims to have found “deterministic structural patterns” in AI inference (the process of running a trained model to answer queries) that reveal where deployed GPUs are wasting cycles, and to have built software that captures that waste as productive output. The company brands the resulting metric Compute Yield™: how much quality-equivalent, accepted AI output an operator gets from infrastructure already in place.

    If the numbers hold up outside Vectris’ own testing, the implications are significant. At even the conservative +30% end of its measured range, the company illustrates that a 10,000-GPU fleet would produce output comparable to 13,000 GPUs — capacity gained without new hardware, new power contracts, or new construction. Vectris is explicit that this is an extrapolation, not a measured deployment.

    The caveats matter as much as the headline. The figures come from one model family (Mistral), one hosting environment (RunPod), and one measuring party (Vectris itself). The release is unusually candid about those limits, which is to its credit — but it also means the claim currently rests entirely on vendor-run benchmarks awaiting independent reproduction.

    Efficiency Is the New Front in the AI Capacity War

    For three years, the dominant response to surging AI demand has been construction: more GPUs, more data centers, more megawatts. But power availability, capital intensity, and build timelines have become structural constraints — a data center can take years to energize, while inference demand compounds monthly. That makes software that extracts more work from installed hardware strategically interesting regardless of which vendor ultimately delivers it. Vectris’ framing — that the binding economic question is shifting from “how many GPUs can you deploy?” to “how much useful output can deployed GPUs produce?” — is a fair description of where operator economics are heading, and it explains why the company says it has engaged a data-center advisory network representing roughly 300 MW of capacity.

    The energy numbers may be the most consequential part of the claim for infrastructure operators. A 51–56% reduction in energy per unit of inference work, if reproducible, would ease the single tightest constraint in the industry — grid power — and change the calculus on every pending interconnection queue. That is precisely why the figure deserves the most scrutiny before anyone builds plans around it.

    What’s Substantiated — and What Isn’t

    The release is more disciplined than most in this category. It names the hardware (H100, H200, B200 on third-party RunPod infrastructure), the workload (Mistral inference), publishes per-GPU figures rather than a single cherry-picked number, labels the 10,000-GPU example as illustrative, and states plainly that results “have not yet been independently reproduced in customer production.” On Intel silicon, Vectris cites 67% energy savings and 32% faster time-to-result using MLPerf LoadGen, a recognized benchmark harness. AMD hardware has been “tested,” but no numbers are given.

    What remains unsubstantiated is the core of the claim. The release does not describe the baseline configuration Waveform was compared against — a critical omission, because inference throughput varies enormously with batching strategy, serving stack, and tuning. A 73% gain over a poorly tuned baseline is a very different achievement than 73% over a well-optimized production stack. Vectris says Waveform targets waste “that remains after conventional optimization,” but offers no detail on what conventional optimization was applied. Nor does it explain the mechanism: “deterministic structural patterns” is evocative but not technical, and “quality-equivalent accepted output” — the foundation of the Compute Yield metric — is not defined in measurable terms. None of this means the claims are wrong; it means they are, for now, claims.

    Winners, Losers, and the Demand Question

    If Waveform performs as described, the clearest winners are inference-heavy operators who are power- or capital-constrained: neoclouds, enterprise AI platforms, and colocation tenants who could defer hardware purchases while serving more demand. Data-center operators face a more nuanced picture — efficiency software could modestly slow demand for new capacity, but historically, cheaper compute has expanded consumption rather than shrinking footprints, a dynamic economists call the Jevons effect. GPU vendors face the same ambiguity: software that makes an H100 do 30–73% more work makes existing fleets more valuable even as it potentially trims marginal unit demand.

    Vectris also enters a genuinely crowded field. Inference optimization is one of the most active areas in AI infrastructure — serving frameworks, compilers, schedulers, and quantization techniques all chase the same waste. Vectris positions Waveform as complementary, a layer above the optimized stack rather than a replacement for it. Whether meaningful recoverable capacity really persists after state-of-the-art serving optimizations is exactly the question independent testing needs to answer.

    From Benchmark to Business

    The commercial plan is early-stage: an October 1, 2026 launch limited to design partners, technical demonstrations with unnamed “AI-infrastructure and channel leaders,” and no disclosed pricing, customers, or funding. The team’s stated pedigree — backgrounds spanning AMD, Graphcore, Oracle Cloud Infrastructure, ByteDance, the U.S. Department of Energy, and Oak Ridge National Laboratory — is relevant to credibility on low-level GPU behavior, but pedigree is not production validation. The supporting quote from Innovate Alabama Chairman Bill Poole speaks to regional economic-development enthusiasm rather than technical endorsement, and the release’s own disclosure notes that third-party names do not imply endorsement. The sensible read: a credible team making a large, testable claim that the market should now test.

    Background

    Vectris Labs is a newly announced entrant in AI infrastructure software, based in Birmingham, Alabama and incubated by venture firm Thumos Capital — a notable geography in an industry concentrated in traditional tech hubs, and one the release leans into with a supporting quote from Innovate Alabama Chairman Bill Poole. The company says it has completed technical demonstrations with AI-infrastructure and channel leaders and engaged a data-center advisory network representing roughly 300 MW of capacity.

    The market context is the defining tension of the current AI buildout: inference — serving trained models to end users — is becoming the dominant AI workload, while power availability and capital costs constrain how fast new GPU capacity can come online. That squeeze has pushed the industry’s attention toward yield: getting more accepted output per deployed GPU, per megawatt, and per dollar, which is precisely the territory Vectris is staking out.

    Source: Vectris Discovers Recoverable AI Compute Capacity Inside Deployed GPUs, Demonstrating Up to 73% More Productive Capacity — Vectris Labs press release via PR Newswire, August 20, 2026, announcing the Waveform control plane and company-measured GPU efficiency results.

  • Mistral’s 1 GW Plan Shows Why Sovereign AI Compute Needs Buyers Before Builders

    Mistral’s 1 GW Plan Shows Why Sovereign AI Compute Needs Buyers Before Builders

    TL;DR · 30-second read

    The Short Version

    Mistral, a French artificial intelligence company, says it plans to build up to one gigawatt of computing capacity by 2030. That is about the output of one large nuclear reactor, all feeding data centers that run artificial intelligence.

    The unusual part is how it wants to pay for it. It is lining up big European companies to commit to years of computer time in advance, so the buildings have customers before they go up.

    The goal is artificial intelligence in Europe that does not depend on American tech giants.

    Mistral AI said in an August 11 blog post that it is taking three steps toward what it calls AI sovereignty. First, Mistral Regional Endpoints are now generally available, letting customers choose whether inference (the work of running a trained model to answer requests) happens in Europe or the US. Second, a new Mistral Priority Tier, in public preview, offers custom rate limits backed by an uptime service-level agreement. Third, Mistral’s platform will host third-party open models, starting with Z.ai’s GLM-5.2.

    Mistral is also assembling an anchor group of enterprises whose multi-year commitments will be converted into European Compute Units (ECUs), giving access to Mistral-built infrastructure over several years. The company says it plans to build up to 1 GW of capacity by 2030. The chief executives of Amadeus, ASML, Capgemini, Caisse des Dépôts and CMA CGM are quoted in support.

    Executive Summary

    The headline products are incremental: region selection for inference and an SLA-backed service tier are features enterprise buyers already expect from large cloud providers. The strategically significant piece is the ECU program, which changes the order in which AI capacity gets built. Rather than constructing data centers and then selling time on them, Mistral is gathering multi-year enterprise commitments first and letting that pooled demand decide what is built, where, and for whom.

    That matters because the 1 GW target is large by European AI-infrastructure standards, and capacity at that scale is hard to finance without contracted revenue behind it. The announcement also broadens Mistral from a model developer into a platform that hosts other developers’ open models on its own regional infrastructure, a move that widens the pool of workloads that can fill the capacity it plans to build.

    What the announcement does not yet show is scale of commitment: no ECU volumes, prices, sites or financing structure were disclosed, and the endorsing CEOs describe support rather than signed quantities.

    Why the 1 GW Plan Starts With Buyers, Not Buildings

    AI capacity is expensive long before it earns anything. Sites, grid connections, cooling systems and accelerators (the specialised chips that run models) are paid for years before the revenue matures, and the chips lose value as newer generations arrive. Lenders typically size financing against contracted revenue, and grid operators and utilities plan more readily around connection requests backed by credible demand. A provider that builds speculatively carries the risk of idle capacity on depreciating hardware.

    European Compute Units are Mistral’s answer to that problem. The company says its anchor group’s multi-year commitments “can support infrastructure in Europe at a scale no participant could secure alone,” and that aggregating long-term demand “will help determine what capacity is built, where it is located, and whom it serves.” In effect, this is an offtake model, familiar from power projects where a plant is financed against buyers who have agreed to take its output, applied to AI compute. The commitments come first; the build follows them.

    The consequences run in several directions. Enterprises trade flexibility for assured access, making a multi-year bet on their own AI usage. For Mistral, pooled commitments are what can turn a target as large as 1 GW, roughly the output of a large nuclear reactor, into phases that can be financed rather than a speculative build. For site developers, utilities and grid operators, one aggregated buyer is easier to plan around than dozens of small ones. Mistral has not said how much has been committed so far, so how much of the 1 GW is already spoken for remains open.

    In-Region Inference, With a Stated Caveat

    Regional Endpoints let customers pin inference to Europe or the US, aligning processing with data-residency rules, sector regulation and latency needs. For European firms handling personal or regulated data, keeping processing in-region simplifies compliance conversations, and Mistral notes that most of its customers already run its models in their own data centers or cloud environments. The endpoints serve those who want Mistral-operated capacity alongside that.

    Mistral is precise about the limits: processing in the chosen region is “subject to limited, safeguarded transfers to sub-processors that may occur outside that region,” as detailed in its Trust Center. That candour is useful, and regulated buyers will want the sub-processor list and the nature of those transfers before treating residency as absolute.

    The Priority Tier adds custom rate limits and an uptime SLA for mission-critical workloads, though the uptime figure and pricing were not published. Mistral’s claim to be the only European AI lab offering both region choice and an SLA-backed tier is scoped to European labs and not independently verifiable from the announcement; large US cloud providers already offer regional, SLA-backed hosting of many models in Europe, which is the comparison many buyers will actually make.

    Third-Party Open Models Help Fill the Capacity

    Mistral’s platform will now run open-weight models from other developers, starting with Z.ai’s GLM-5.2, under the same infrastructure, regional controls and service commitments as Mistral’s own models. Open weights mean the trained model parameters are published, so a customer can inspect, adapt and host the model where it chooses.

    The commercial logic ties directly to the capacity plan. A platform that hosts several models keeps a customer’s workloads, and spend, on Mistral infrastructure even when another developer’s model suits a task better. Factory’s CEO, Matan Grinberg, frames it this way: different workloads need different models, and running them under one set of regional controls eases compliance. Utilisation is what makes data center capacity pay for itself, and a broader catalogue widens the demand that can fill 1 GW.

    There is a nuance buyers will weigh. Z.ai is a Chinese developer. Running its open weights on European infrastructure means prompts and data need not reach the model’s creator, but some public-sector and regulated buyers apply provenance policies to models themselves, not just to where they run. How much that matters will depend on each organisation’s own rules.

    Endorsements Are Not Yet Contracts

    The breadth of names quoted is notable: travel technology (Amadeus), semiconductor equipment (ASML), IT services (Capgemini), French public finance (Caisse des Dépôts) and shipping and logistics (CMA CGM). That spread suggests appetite for European AI capacity well beyond the tech sector.

    The quotes, however, describe ambition and confidence rather than quantities. None specifies a capacity figure, contract length or value, and the announcement does not say which of these organisations hold ECU commitments. ASML is also a significant investor in Mistral, which is relevant context for its endorsement. The most concrete usage claim comes from CMA CGM, which says deployment is already under way among thousands of employees. Caisse des Dépôts describes Mistral Compute as a “European neocloud,” a term for newer providers that specialise in renting AI compute.

    The test between now and 2030 is conversion: whether endorsements become signed ECU volumes large enough to anchor each successive phase of the build.

    Background

    Mistral AI is a Paris-based AI developer founded in 2023 and best known for releasing open-weight models alongside commercial ones. Its product line now spans Studio for building agents and apps, Forge for training and customising models, the Vibe agents, and an AI Cloud business, Mistral Compute, that provides infrastructure for training and inference. Most of its customers today run its models inside their own data centers and cloud environments.

    The announcement lands in a long-running European debate over dependence on US cloud providers for critical digital infrastructure. European organisations operate under data-protection rules such as GDPR and the EU AI Act, and many public bodies and regulated industries want assurance about where data is processed and who controls the underlying systems. Demand for AI capacity has made that question more pressing, because the compute behind modern AI is scarce, capital-intensive and concentrated among a few large providers.

    Sources

    Source: In-region inference, open models, and new European infrastructure for sovereign AI. Mistral AI’s announcement of Regional Endpoints, the Priority Tier, third-party open models and the European Compute Units program.