tech
Nvidia's new world model helps robots navigate the world
The chip giants aims to become a platform for physical AI.
TL;DR
- Nvidia launched Cosmos 3, an open AI world model for physical systems.
- The model helps robots and autonomous vehicles understand and predict real-world environments.
- Cosmos 3 is trained on 20 trillion tokens of multimodal data, focusing on action data for machine movement.
- Developers can use Cosmos 3 to simulate actions and build task-specific models.
- It generates action data like robot joint angles and trajectories to train machines.
- Cosmos is open, allowing hardware makers to customize it for their needs.
- Nvidia is forming a coalition of supporting companies.
- The model can generate rare or dangerous scenarios for training.
- Two versions, 'super' and 'nano', are immediately available, with an 'edge' version coming soon.
- World models are a growing AI area for enabling real-world tasks.
- Nvidia's strategy is to be the starting point for AI development in the physical world.