NVIDIA Cosmos-H-Dreams: Bringing Real-Time Generative Simulation to Surgical Robotics

Back to Articles NVIDIA Cosmos-H-Dreams: Bringing Real-Time Generative Simulation to Surgical Robotics Enterprise + Article Published July 27, 2026 Upvote - Lukas Zbinden lzbinden Follow nvidia Javier javirk1 Follow nvidia Mostafa Toloui mtoloui Follow nvidia Sean Huver shuver Follow nvidia Surgical robotics is moving quickly from teleoperation toward increasingly capable vision-language-action policies.

But evaluating and training these systems remains difficult.Physical robotic platforms are expensive to operate, experiments are slow to reproduce, and failures can damage instruments or biological material.

Conventional simulators provide a safer alternative, but surgical scenes are exceptionally difficult to model: deformable tissue, fine instrument interactions, specular surfaces, sutures, needles, smoke, and occlusions all matter.World foundation models offer a different path.

Instead of manually authoring every object and physical interaction, they learn visual dynamics directly from synchronized video and robot kinematics.

NVIDIA's Cosmos-H-Surgical-Simulator demonstrated this approach by generating future surgical video from an initial scene and a sequence of robot actions.It enabled faster-than-physical evaluation and synthetic data generation across the Open-H-Embodiment ecosystem.

Today, we are introducing the next step: Cosmos-H-Dreams, a real-time, action-conditioned generative simulator for surgical robotics.