NVIDIA signals AI inference demand inflection, commits $100-150B in Taiwan

NVIDIA framed a structural shift in demand: inference, not training, is now the inflection point, driven by agentic AI running at scale across enterprises. As agents make many more model calls per task, aggregate inference compute balloons — a thesis that aligns with this week's AWS AgentCore Payments and the broader agent-economy narrative. CEO Jensen Huang underscored the bet with a commitment of $100-150 billion in annual Taiwan spending across manufacturing and supply chain.

On product, NVIDIA confirmed Vera Rubin CPU delivery to leading AI firms, with broader partner availability slated for the second half of 2026. The vertical integration — CPUs plus GPUs plus networking — is aimed at owning the full agentic-inference stack. NVIDIA also adopted the Linux Foundation's OpenMDW framework across its open model families to standardize open-model licensing.

Forums read the Taiwan commitment as validation that agentic workloads will dominate 2026-2027 compute demand, with speculation about whether GPU supply can meet projected $3-4 trillion in annual AI spend. The skeptical counterpoint, surfacing in r/artificial threads citing Microsoft data, is that AI may be more expensive than hiring people for many tasks — raising the question of whether the inference demand curve is as steep as NVIDIA's capex implies, or whether cost-rationing eventually bends it.