NVIDIA 開源 OSMO:一個 YAML 即可編排物理 AI 訓練、模擬與機器人測試

2026年9月14日 08:04
站內 AI 整理稿

Robot developers do not have one compute problem.They have 3.A policy is trained on GB200 or H100 clusters, tested in Isaac Sim on RTX GPUs, then validated on a Jetson mounted inside a real robot.Each tier has its own cluster, its own scheduler, and its own glue scripts.

NVIDIA OSMO is NVIDIA’s answer to that fragmentation: an open-source, Kubernetes-native workflow orchestrator that lets a team describe the whole pipeline in a single YAML file and run it across every tier without touching infrastructure code.Deployable?Yes.OSMO is Apache-2.

0 licensed, ships Helm charts and containers on NGC, and has a local quickstart that runs the full control plane on a workstation with KIND.The Three Computer Problem NVIDIA frames physical AI as a three computer problem.Training happens on data-center GPUs.

Simulation, physics, and sensor rendering happen on workstation-class RTX hardware.Deployment and hardware-in-the-loop (HIL) testing happen on edge devices such as Jetson AGX Thor, usually on premises.Each tier usually gets its own tooling, and the handoffs are where custom scripts accumulate.

OSMO treats all 3 as backends of one control plane.Each backend is a Kubernetes cluster registered through the CLI.Workflows never name a cluster.They name a platform (for example gb200, rtx-pro-6000, or jetson-agx-thor) and OSMO routes the task to a pool that offers it.

What a Workflow Looks Liake The Repo’s canonical example is 3 tasks cAhained by data:A simulation runs an Isaac Sim container on rtx-pro-6000 train-policy runs a PyTorch container on gb200 with 8 GPUs, taking the simulation task’s output as input evaluate-thor runs a ROS app on jetson-agx-thor, consuming the trained policy and writing results to a named dataset Dependencies come from inputs, persistence from outputs, and placement from platform.

The user guide covers serial and parallel task groups, Jinja templating for parameterized workflows, retry policies, and HIGH/NORMAL/LOW priorities with preemption and GPU borrowing across pools.

Key Capabilities Portability: The same YAML runs on a laptop (Docker/KIND) or on EKS, AKS, GKE, on-premise, or air-gapped clusters.The 6.3.0 release added a multi-provider deploy-k8s.

sh that provisions OSMO on Azure AKS, AWS EKS, microk8s, or any existing cluster, with storage wiring for MinIO, Azure Blob, AWS S3, or bring-your-own S3.

Interactive development: Developers can launch VS Code, Jupyter, or SSH sessions on a remote GPU node, exec into running tasks, port-forward services, and rsync files in both directions.Version 6.3.0 added osmo workflow rsync download with a live progress bar.

Scheduling: OSMO uses the NVIDIA KAI Scheduler by default.Release 6.2.8 added NVLink topology-aware placement for multi-GPU tasks.Release 6.3.0 made exectimeout and queuetimeout per group, so a stalled simulation group no longer kills sibling training groups.

Data: The project describes content-addressable datasets with deduplication that it claims can cut storage by 10 to 100x.Note that the standalone osmo dataset CLI and /datasets API were deprecated in 6.3.0 and are slated for removal in 6.4, with workflow-managed dataset outputs as the replacement.

Security and identity: Since 6.2.8 OSMO ships an RBAC authorization sidecar, OAuth2 proxy integration with device-code login, and identity-provider user mapping.Release 6.3.

0 added TLS termination at the Envoy gateway and cloud workload identity (Azure Workload Identity, AWS IRSA/Pod Identity) so services no longer mount storage keys as Kubernetes Secrets.Release 6.3.1 tightened the default osmo-user role to the default pool.

Agent integration: The repository ships an AGENTS.md, a skills directory, and an MCP deployment guide.At GTC 2026 NVIDIA said OSMO integrates with Claude Code, OpenAI Codex, and Cursor so coding agents can submit, monitor, and debug pipelines.

Interactive Explainer: Watch OSMO Route One Workflow Across 3 Compute Tiers Press Run workflow to see how OSMO schedules the README example task by task.Click any tier or step number to inspect what happens there.(function(){ var f=document.getElementById('osmo-explainer-frame'); window.

addEventListener('message',function(e){ if(e.data&&e.data.type==='osmo-explainer-height'&&f){f.style.height=e.data.height+'px';} }); })(); Key Takeaways OSMO orchestrates training, simulation, and edge HIL tasks from one YAML across heterogeneous Kubernetes clusters Apache-2.

0, Helm charts on NGC, latest release 6.3.

1 (June 2026), local KIND quickstart available KAI Scheduler default, NVLink-aware placement, per-group timeouts, RBAC and OAuth2 built in Battle-tested on GR00T, Isaac Lab, Isaac Sim, and Isaac ROS; Azure and Nebius integrations exist Dataset CLI is deprecated in 6.3 and removed in 6.

4; plan migrations accordingly Check out the GitHub, Documentation, Releases, Cookbook and NVIDIA OSMO page.All credit goes to the researcher of this project.Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter.Wait!

are you on telegram?now you can join us on telegram as well.Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.?

Connect with us The post NVIDIA Open-Sources OSMO: One YAML Orchestrates Physical AI Training, Simulation, and Robot Testing appeared first on MarkTechPost.

Related

相關文章

雷峰網AI Agent

香港大學發佈全球首個KYA報告關注智能體信任建設,九類企業實踐獲收錄

11月3日,香港大學副校長汪揚教授與香港大學經管學院楊宏副教授代表香港大學KYA課題組,在2026年香港金融科技周 x StartmeupHK創業節發佈全球首個KYA(Know Your Agent)領域報告《KYA:智能體信用體系研究報告》。報告聚焦智能體參與真實經濟活動後的身份、授權、信用與責任問題,結合109份從業者有效問卷及包含Stripe、螞蟻數科等近十個企業案例,提出智能體成熟度模型、KYA框架和智能體發展指數,並進一步探討“智能體信任資本”的形成及其經濟價值。“沒有KYA,就沒有智能體經濟。

3 小時前
智東西AI Agent

Grok Bot暗暗砍額度,馬斯克承認:成本難持續

編譯 | 黃菲 編輯 | 江宇 11月3日消息,據TechCrunch報道,近日,SpaceXSI旗下AI Agent產品Grok Bot因服務成本過高,開始收緊用戶使用額度。特斯拉CEO、SpaceXSI創始人兼CEO埃隆·馬斯克(Elon Musk)11月2日在X上回應稱,Grok Bot的服務成本相對於收入而言已經高得難以持續,此前用戶反饋的額度異常消耗並非系統故障。

5 小時前
雷峰網AI Agent

小米斬獲烏鎮峰會雙料大獎:小米集團獲“傑出貢獻獎”,小米具身基座模型獲“領先科技獎”

11月3日,小米方面披露,小米集團獲得2026世界互聯網大會“傑出貢獻獎”創新突破類獎項,該獎項旨在表彰全球互聯網相關領域作出傑出貢獻的個人和企業。同時,小米機器人業務“面向規模化落地的通用機器人操作基座模型關鍵技術”獲大會“領先科技獎”,該獎項旨在獎勵全球年度最具領先性的互聯網科技成果。峰會期間,小米還對外披露了機器人業務在工業製造和家庭場景的兩項最新落地進展。

5 小時前
雷峰網AI Agent

當三體IP開始連接 AI 和硬科技,到底在探索什麼?

“不要回答!不要回答!!不要回答!!!”《三體》中,來自宇宙深處的信號曾讓人類面臨重大抉擇,二十年後,當 AI 可以理解文本、生成 3D 模型,甚至以智能體的形式與人對話,人類能否藉助這些技術,主動進入科幻作品所描繪的世界?10月24日至25日,在北京舉辦的2026三體日·脫水浸泡嘉年華上,三體宇宙(三體IP的版權方和運營方)開始嘗試回答這個問題。

6 小時前
雷峰網AI Agent

尋找AI時代的下一個黑馬:安全創客匯重磅升級為AI創客匯

11月3日,在2026年世界互聯網大會烏鎮峰會期間,奇安信宣佈:國內網絡安全領域最具影響力的專業創投平臺之一——安全創客匯,即日起正式升級為“AI創客匯”。新平臺將延續過去嚴苛的選拔機制與創投生態,而賽道邊界將徹底打開——由聚焦網絡安全領域,升級為更加廣闊的AI創新與應用領域,旨在發現和挖掘那些在AI浪潮中搏擊的“創新黑馬”。 本次升級不僅是名稱的更迭,更是一次順應時代潮汐的戰略躍遷:一個以安全為底色的專業創投平臺,正式向整個AI時代的創新者發出邀請函。

6 小時前