NVIDIA has expanded its Cosmos platform for physical AI with five Cosmos Data Factory blueprints, training tools for open robot and driving models, and new inference options. The announcement carries four efficiency figures, and each rests on a different footing: one is expected, one is a vendor-validated configuration, and two come from named customers.

What NVIDIA released

According to NVIDIA’s blog post on the Cosmos expansion, the update has three parts. Cosmos Data Factory is a set of tools for labeling, curating, augmenting and evaluating the data used to train physical AI. Cosmos Framework adds training, optimization and deployment recipes that developers and agents can apply to more open models. The third part covers simulation checkpoints and inference microservices for testing and running the models.

Data Factory now offers five cloud-native blueprints, available through GitHub, Microsoft Azure, Nebius and CoreWeave:

Advertisement

AITech Your brand belongs here. Reach the decision-makers who read AITech every day. Premium placements across the site and newsletter. Advertise with us
  • Autonomous Vehicle Dataset Generation, which curates and labels driving data and adds synthetic examples of hard-to-capture scenarios.
  • Image Attribute Augmentation, which varies object appearance to improve image search.
  • Event Video Generation, which turns still images into synthetic videos of rare or unsafe events.
  • Defect Image Generation, which produces printed circuit board, metal and glass defect images for inspection models.
  • Video Data Augmentation, which changes weather and lighting in existing footage while preserving scene structure.

Cosmos Curator, the GPU-accelerated tool for curating video datasets, now supports multimodal and multisensory inputs. At GTC Berlin, NVIDIA extended Cosmos Framework to open models including GR00T, Alpamayo, QWEN, Pi0.5 and other compatible Hugging Face models. Developers and agents can fine-tune them with supervised and reinforcement learning, shrink them through distillation and quantization, and deploy them for inference. New Cosmos 3 Nano variants let teams test autonomous-vehicle and bimanual-robot policies in repeatable multiview, multisensor simulations before any real-world trial.

Four figures, four levels of evidence

NVIDIA’s post is the only source for each number below.

Porsche: up to 90% fewer repeated test drives, up to 85% shorter development cycles

NVIDIA says Porsche is leading a shared autonomous-vehicle data flywheel across Volkswagen Group brands, using Cosmos Data Factory through Voxel51 on Azure. The post says the result “is expected to reduce” repeated physical test drives by up to 90% and shorten development cycle times by up to 85%. Both are forecasts with an “up to” ceiling, and the post gives no measured baseline.

Cosmos 3 NIM microservices: up to 2x faster inference

This one is a vendor benchmark. NVIDIA says the microservices deliver the speedup “with no quality loss in validated configurations.” The qualifier limits the claim to setups NVIDIA has tested, so a team running a different GPU, batch size or model variant has no stated result.

Metropolis video search and summarization blueprint 3.3: 40% more video streams on the same GPU

NVIDIA says teams can monitor 40% more streams with the same GPU. The post does not state the baseline workload or the model used.

MicroAGI: a 32-billion-parameter reasoner distilled to an 8-billion-parameter Nano model

This is a customer result, reported by NVIDIA, on a model post-trained on videos of humans manipulating objects. It describes one lab’s task, and the post does not say which accuracy measure was used.

Newsletter

Get the week's best tech coverage.

Free. Read by thousands of HR, tech, and business leaders.

The post also lists results that are counts rather than percentages. ANYbotics generated over 1,500 synthetic video clips with the blueprints to train inspection robots to recognize liquid spills. ADNOC uses Fogsphere’s MistIQ platform, built with Cosmos and the Metropolis blueprint, to detect safety hazards across 65 sites. Ultralytics retrained its YOLO model with targeted synthetic defects and reports better defect localization and recall, with no numbers given.

What it means for the buying committee

Physical AI belongs on a CIO’s roadmap wherever the company runs cameras, vehicles, inspection robots or plant equipment, and the cost sits in data. Real footage of a spill, a cracked circuit board or a near-miss is rare by definition. Synthetic generation addresses that gap, and the five blueprints are packaged for three clouds that many enterprises already contract with. That lowers the procurement work for a pilot, since the workloads can run in an existing cloud agreement.

Three checks belong in any pilot plan. First, treat Porsche’s 90% and 85% as hypotheses to test against your own test-drive or inspection volume. Second, ask NVIDIA for the configuration list behind the 2x inference claim and match it to the hardware you plan to buy. Third, read the license on every model you intend to adapt. The post describes the platform as open and modular but, in the text reviewed, does not state a license. NVIDIA’s robotics lab released its Flora labeling models days earlier under a noncommercial license, which we covered in NVIDIA Releases Flora Robot Labeling Models Under a Noncommercial License. A model that cannot go into production changes the cost case from the first line.

The spend side is also large. Our coverage of Gartner’s estimate that infrastructure takes more than half of global AI spend is the backdrop: synthetic data generation and closed-loop simulation both run on GPUs, so a physical AI program adds compute demand on top of any inference footprint already planned.

What to ask vendors this quarter

For a CIO or head of data who is scoping a physical AI pilot, the post supports a short list. Ask which of the five blueprints maps to a data shortage you can name, such as defect images for a specific line. Ask for the licensing terms of each model in the adaptation path. Ask the cloud provider what the blueprint costs to run per thousand clips. And ask for a measured result from a customer in your industry, since the only measured figure in the post is a clip count and every percentage is either a forecast or a vendor benchmark.

Source: NVIDIA Blog