NVIDIA launches Cosmos 3, first fully open omni-model for physical AI

At GTC Taipei, NVIDIA unveiled Cosmos 3, a leaderboard-topping open world foundation model for physical AI built on a mixture-of-transformers architecture that unifies vision reasoning, world generation and action prediction in a single system. NVIDIA calls it the world's first fully open omni-model, able to natively understand and generate text, images, video, ambient sound and actions with leading physics accuracy — collapsing physical-AI training and evaluation cycles 'from months to days.' It ships in Nano (16B) and Super (64B parameter) sizes on Hugging Face.

'The big bang of physical AI is just around the corner thanks to breakthroughs in multimodal reasoning language, vision and world models,' said Jensen Huang. NVIDIA also launched the Cosmos Coalition, a collaboration of world-model builders and robotics leaders — Agile Robots, Black Forest Labs, Generalist, LTX, Runway and Skild AI — to advance open world models. The release pairs with a new consumer PC AI chip and DLSS 4.5 Ray Reconstruction.

The unified architecture is the key technical bet: instead of stitching together separate vision encoders, world simulators and policy models for robotics, autonomous vehicles and smart spaces, Cosmos 3 handles all of it in one system for synthetic data generation and policy development.

The launch lands squarely in the week's 'let's get physical' theme, with Sam Altman declaring robotics OpenAI's next frontier and Meta reportedly building a pendant wearable. On r/StableDiffusion, the Cosmos3-Super image-to-video model drew strong interest, with one user running the 64B model locally on a single RTX PRO 6000 96GB (98 upvotes, 99 comments). The open-weights release is genuinely notable, but watch whether the Coalition partners ship real deployed robots or whether 'physical AI' remains demo-stage. Independent benchmarks against closed world models will tell the real story.