| Intended Application & Domain |
World generation and simulation for Physical AI, specifically action-conditioned simulation of bimanual robot manipulation and camera navigation for policy evaluation, reinforcement learning, and synthetic demonstration data generation. |
| Model Type |
Transformer-based Mixture-of-Transformers (MoT) model, derived from Cosmos3-Nano through robot-action and camera-trajectory-conditioned post-training, followed by causal distillation. |
| Intended Users |
Physical AI developers, researchers, and practitioners building or evaluating robotic manipulation policies and neural simulation workflows. |
| Output |
Video in MP4 format or streamed video frames depicting the environment’s response to supplied robot actions and camera trajectories. |
| Tools used to evaluate datasets to identify synthetic data and ensure data authenticity. |
Dataset provenance analysis, metadata validation, watermark and artifact detection, embedding-based clustering, heuristic quality checks, and model-assisted data validation pipelines are used to identify synthetic content patterns, assess dataset authenticity, and improve data quality during dataset curation. |
| Describe how the model works |
The model generates video conditioned on an initial image, robot actions, and camera trajectories. It uses cached history and incoming controls to simulate how an environment responds to robot actions and viewpoint changes. |
| List the groups or group characteristics for which this was tested to produce comparable outcomes |
None. |
| Technical Limitations & Mitigation |
The model may not follow input conditions accurately in challenging cases, especially those involving complex scene composition, unusual camera motion, multiple interacting agents, low lighting, high motion blur, or fine-grained physical interactions. Generated outputs may contain temporal inconsistency, object morphing, inaccurate 3D structure, or implausible physical dynamics. Users should validate output quality and adherence to input conditions for their intended use cases. |
| Verified to have met prescribed NVIDIA quality standards |
Yes. |
| Performance Metrics |
Evaluation uses AgiBot-World and AgiBot-GEAR validation sequences. PSNR, SSIM, and LPIPS assess action following through frame-wise comparison with reference videos. PAI-Bench-G measures video quality, while quality drift and temporal Sampson error assess long-horizon consistency. These metrics are listed in the overview; please see the overview for numerical results. |
| Potential Known Risks |
This model can generate synthetic media and may produce content that is offensive, unsafe, misleading, indecent, or unsuitable for a target deployment. Users should implement robust safety guardrails — including content filtering, abuse monitoring, and access controls — to reduce the risk of harmful outputs. Users are responsible for ensuring that their use of the model complies with all applicable laws and regulations, and for regularly reviewing and updating their guardrails as risks evolve. |
| Licensing |
OpenMDW1.1 |
