仿真与数据平台生态整合研究


1. 介绍

本篇是 07-具身智能组的收官整合篇,研究对象不是单一厂商,而是具身智能的基础设施层:仿真平台、世界模型与数据集 / 数采基座。前九篇中所有厂商的模型迭代——无论宇树的 WVLA、Figure 的 Helix 还是 PI 的 π 系列——都依赖这层基础设施供给训练数据与评估环境。其组内差异主线是「基础设施层」:谁控制了仿真与数据,谁就控制了具身智能的迭代速度。

1.1. 整合篇说明:基础设施层

仿真与数据平台在 Harness 六层模型中横跨三层:合成数据生成服务于 L1(上下文 / 训练语料)与 L4(数据资产);仿真评估直接是 L5(评估与观测)的具身形态;许可体系与行业标准属于 L6(治理)。本篇按「国际栈—竞品引擎—国产栈—数据基座」四段展开,并给出仿真-数据-训练的闭环视图。

1.2. 三层生态结构

代表角色
国际栈NVIDIA Isaac / Cosmos / GR00T / OSMO;MuJoCo;Gazebo;Genesis;Newton仿真引擎、世界模型与开发平台的全球事实标准
国产栈智元 Genie Sim 3.0、中兴 RealMirror、无问智科、51Sim、光轮智能、灵初智能、觅蜂科技本土仿真基座与数据服务
数据集 / 数采基座RoboMIND(北京人形机器人创新中心)、AgiBot World(智元)、各厂数采工厂真机数据供给与数据产业

2. 名词解释

术语英文 / 缩写释义
Isaac SimNVIDIA 基于 Omniverse + PhysX 5 的旗舰机器人仿真器,RTX 渲染,支持数字孪生与合成感知数据
Isaac LabNVIDIA 开源(BSD-3)机器人学习框架,单卡可跑 4096~8192 个并行环境,预置 16+ 机型
CosmosNVIDIA 世界基础模型系列(Curator / Predict / Transfer / Reason / RL 五模块),用于生成合成训练数据
GR00TNVIDIA 人形机器人基础模型与开放参考平台,含数据管线、模型、仿真与 Jetson Thor 运行时
OSMONVIDIA 云原生工作流编排平台,串起「仿真—训练—部署」的算力流水线
Isaac Lab-ArenaNVIDIA 的通用机器人策略仿真评测平台
NewtonLinux 基金会治理的开源物理引擎(基于 NVIDIA Warp / OpenUSD),DeepMind 与迪士尼联合开发,支持可微分物理
MuJoCo / MJXDeepMind 物理引擎及其 GPU 加速版(MJX),学术界的默认选择
Genesis纯 Python 多物理引擎(刚体 + 软体 + 流体),10000+ 并行环境,独立于 NVIDIA 生态
Sim2RealSimulation to Reality仿真训练到真机部署的迁移;斯坦福 HAI 2026 口径下仿真成功率 89.4% vs 真实家庭 12%
Real2Sim2Real先把真实场景重建为仿真、再闭环迁移回真机的数据管线
合成数据Synthetic Data仿真 / 生成式模型产出的训练数据,可无限扩充且自带标注
数采工厂Data Collection Factory以遥操作为主、批量采集真机示教数据的设施(详见 02-agibot.md)
RoboMIND北京人形机器人创新中心开源的多本体操作数据集,全球下载已破 2000 万次
AgiBot World智元开源的百万真机数据集,规模为 DROID 的 10 倍以上
无本体数据Bodyless Data不绑定特定机型的通用操作数据(觅蜂科技累计 100 万小时)
数据不可能三角行业说法:数据规模、质量、成本三者难以同时满足
Physical AI英伟达提出的「物理 AI」概念域,GTC 2026 列为五大战略支柱之一

3. 功能说明与生态版图

3.1. 国际栈:NVIDIA 为事实标准

NVIDIA Isaac 平台是当前机器人仿真的事实标准,官网定位为「AI Robot Development Platform」,由仿真(Isaac Sim)、机器人学习(Isaac Lab)、CUDA 加速库、AI 模型与参考工作流组成。关键能力:

  1. Isaac Sim:Omniverse + PhysX 5 + RTX 渲染,支持数字孪生与合成感知数据生成。
  2. Isaac Lab:BSD-3 开源 RL 框架,单卡 4096~8192 并行环境,内置 RSL-RL / RL-Games / SKRL / SB3,预置 G1 / H1 / Spot / ANYmal / Franka 等 16+ 机型;3.0 beta(2026-03)起可选 Newton + MuJoCo Warp 求解器、并可脱离 Isaac Sim 运行时独立使用。
  3. Cosmos 世界模型系列:Curator / Predict / Transfer / Reason / RL 五模块;Cosmos 3 于 2026 GTC 发布,定位「物理 AI 前沿基础模型」;Physical AI Data Factory Blueprint 统一自动化数据生成。
  4. GR00T + OSMO + Isaac Lab-Arena:人形基础模型、算力编排与策略评测平台的三件套。
  5. 生态位:GTC 2026 英伟达称 Physical AI 为五大战略支柱之一;2026 年初已有 110 家机器人「大脑」开发者与产业伙伴基于其栈。

许可要点(L6 素材):Isaac Sim 源码 Apache 2.0,但依赖 Omniverse Kit SDK 与资产,再分发需 NVIDIA AI Enterprise 许可——「源码开源、运行时受控」的组合。

3.2. 竞品物理引擎

引擎治理方特点
MuJoCo / MJXGoogle DeepMindGPU 加速(MJX),学术界默认选择
GazeboROS 生态与 ROS / ROS 2 深度绑定
Genesis开源社区纯 Python,多物理(刚体 + 软体 + 流体),10000+ 并行环境,独立于 NVIDIA
NewtonLinux 基金会基于 NVIDIA Warp / OpenUSD,DeepMind 与迪士尼联合开发,可微分物理,Beta 已开放

3.3. 国产栈

平台主体定位
Genie Sim 3.0智元2026-01 CES 发布,业内首个大语言模型驱动的开源具身仿真平台
RealMirror中兴端到端 VLA 仿真基座:数采-训练-推理-评测-Sim2Real 一体,零样本迁移,开源资产下载 2400+
无问智科无问智科世界模型驱动,Real2Sim2Real 全链路闭环
SimOne 4.051Sim4DGS 重建 + 生成式世界模型
光轮智能光轮智能仿真-数据-评测闭环
灵初智能灵初智能开源 1000 小时人类手部操作全模态数据集
觅蜂科技觅蜂科技累计 100 万小时高质量无本体数据

配套治理动作:工信部发布《人形机器人与具身智能标准体系(2026 版)》,为首个覆盖全产业链的标准体系。

3.4. 数据集与数采基座

两大开源真机数据集构成数据层的公共品:AgiBot World(智元,2024-12 开源,百万真机数据,五大场景 100+ 任务,规模为 DROID 的 10 倍以上)与 RoboMIND(北京人形机器人创新中心,2025-12 开源,30 万+ 条双臂操作轨迹、700+ 项实操任务)。数采基座方面,北京人形的数据基地(近 6000 平方米、40 余个模拟实景分区、40 种构型 150+ 台机器人 + 100 余台无本体设备「矩阵式采集」)代表了当前国内数采设施的最高规格。行业数据底数:全行业高质量真实物理交互数据约 50 万小时,而可用水平需约 1000 万小时——缺口约 20 倍(单一综述稿口径,C 级,引用须标注)。


4. 平台架构

4.1. NVIDIA 全栈分层

NVIDIA 的具身智能栈自上而下为:Cosmos 世界模型(数据生成)→ Isaac Sim / Lab(仿真与训练)→ GR00T(人形基础模型)→ OSMO(编排)→ Jetson Thor(端侧推理),DGX / OVX / AGX 三类硬件平台分别支撑训练、仿真测试与部署。Isaac Lab 3.0 引入 Newton + MuJoCo Warp 可选求解器并支持脱离 Isaac Sim 独立运行,显示 NVIDIA 在「平台锁定」与「开放解耦」之间的再平衡。

4.2. RoboMIND 数据超级工厂

北京人形机器人创新中心的「数据超级工厂」打通了「采集 → 清洗 → 质检 → 标注 → 训练 → 真机评测 → 部署 → 回流」全闭环(24 小时自动化质检):年产能 18 万小时、已交付近 3 万小时、七成服务行业客户、长目标 100 万小时。其标志性成果之一是天工机器人在该基地数据支撑下跑出百米 8.64 秒。

4.3. 仿真—数据—训练闭环图

图 10-1|仿真-数据-训练-真机部署的产业闭环(示意)

仿真-数据-训练-部署闭环与三层供给(示意) 仿真环境 Isaac Sim / Lab Genesis / MuJoCo / Newton Genie Sim 3.0 / RealMirror 数据供给 合成数据(Cosmos) 遥操作真机数据 无本体数据 100 万小时 模型训练 GR00T / GO 系列 / π 系列 Helix / ERA-42 OSMO 编排算力 真机部署 量产本体验证 工况数据回流 闭环 24h 质检 部署工况回流仿真与数据层(Real2Sim2Real / 数据飞轮) 数据集公共品 RoboMIND 下载 2000 万+ AgiBot World 百万真机 评测公共品 Isaac Lab-Arena π0.5 学界基线 治理公共品 工信部标准体系 2026 版 Isaac 许可边界 核心矛盾:行业高质量真机数据约 50 万小时 vs 可用水平需约 1000 万小时(缺口约 20 倍,C 级口径) Sim2Real 差距:机器人操控仿真成功率 89.4% vs 真实家庭 12%(斯坦福 HAI AI Index 2026)

示意:基于本文分析绘制;数据缺口与 Sim2Real 数字为第三方口径并已在正文标注可信度等级。


5. Harness 设计

本篇的 Harness 分析视角特殊:仿真与数据平台本身就是其他厂商 Harness 的上游组件。以下按六层给出「基础设施层」自身的观察。

5.1. L1 上下文工程层

合成数据与世界模型是具身领域的「预训练语料工厂」:Cosmos 的自动化数据生成与 Physical AI Data Factory Blueprint,本质是把场景先验(L1 上下文)在仿真中批量制造。RoboMIND / AgiBot World 等开源数据集则把真实世界的上下文公共品化,降低了所有下游模型的 L1 门槛。

5.2. L2 工具与执行层

Isaac Lab 单卡 4096~8192 并行环境使「工具执行」可以以万级规模并发;Genesis 的 10000+ 并行环境、MuJoCo Warp / Newton 的 GPU 求解器都在做同一件事——把物理执行的试错成本压到接近零。执行层的真机部分(Jetson Thor、Isaac TeleOp)由 NVIDIA 栈向下延伸到本体。

5.3. L3 编排与控制层

OSMO 是该层最明确的基础设施产品:云原生工作流编排,串起数据生成、训练、评测、部署的跨集群调度——等价于具身智能领域的 CI/CD 流水线。国产侧,Genie Studio(智元)承担同类角色(详见 02-agibot.md)。

5.4. L4 记忆与状态层

数据基地与数据集就是行业级的 L4:RoboMIND 的「矩阵式采集」(40 构型 150+ 台机器人 + 100 余台无本体设备)把经验以标准化结构沉淀;觅蜂科技 100 万小时无本体数据说明「与本体解耦的经验资产」已可规模化生产。

5.5. 评估与观测层

这是基础设施层对 Harness 体系的最大贡献:Isaac Lab-Arena(通用策略仿真评测)与 π0.5 学界基线(详见 08-physical-intelligence.md)构成评测公共品的雏形;RoboMIND 的「训练→真机评测→部署→回流」闭环把 L5 从分数变成运营流程。斯坦福 HAI AI Index 2026 给出了该层的核心度量——仿真成功率 89.4% vs 真实家庭 12%,Sim2Real 差距 77 个百分点,说明当前 L5 的仿真评估与真机表现之间存在系统性失真。

5.6. L6 治理与安全层

三个治理证据:Isaac Sim「源码 Apache 2.0、运行时依赖受控许可」的开源-商业边界设计;工信部《人形机器人与具身智能标准体系(2026 版)》的全产业链标准框架;RoboMIND 数据集的 CR 类合规实践与 24 小时自动化质检(数据质量治理)。数据主权(真机场景数据的归属与出境)是尚未形成标准的治理空白。

5.7. 六层强弱小结

评级依据
L1 上下文工程★★★Cosmos 数据工厂 + 开源数据集公共品化
L2 工具与执行★★★万级并行仿真 + GPU 物理求解器
L3 编排与控制★★★OSMO / Genie Studio 流水线编排
L4 记忆与状态★★★数据基地矩阵式采集 + 无本体数据资产
L5 评估与观测★★★Lab-Arena + 基线模型 + 全闭环质检(Sim2Real 失真是最大缺口)
L6 治理与安全★★许可边界 + 国家标准体系;数据主权空白

6. 实际案例

6.1. RoboMIND:下载破 2000 万次的数据基础设施

北京人形机器人创新中心的 RoboMIND 数据集自 2025-12 开源以来,全球下载量于 2026-09-02 宣布突破 2000 万次(一个月内翻倍)。其数据基地近 6000 平方米、40 余个模拟实景分区、40 种构型 150+ 台机器人加 100 余台无本体设备矩阵式采集,年产能 18 万小时、已交付近 3 万小时、七成服务行业客户,长目标 100 万小时;打通采集→清洗→质检→标注→训练→真机评测→部署→回流全闭环,24 小时自动化质检。依托基地数据,天工机器人实现百米 8.64 秒。这是「数据即基础设施」叙事的最完整公开样本。

6.2. Sim2Real 差距的量化证据

斯坦福 HAI AI Index 2026:机器人操控仿真成功率 89.4%,真实家庭环境仅 12%——77 个百分点的 Sim2Real 差距是本组所有「仿真评估」宣称必须直面的边界条件。与之相关,行业高质量真机数据约 50 万小时 vs 需求约 1000 万小时(缺口 20 倍,C 级单源口径),2026 年国内具身数据服务市场规模机构测算超 1500 亿元。两组数字共同解释了为什么数采工厂(智元、北京人形、优必选自贡)在 2026 年密集出现:仿真解决不了的那 77 个百分点,短期只能靠真机数据硬补。

6.3. 数采质量的三方争论

2026-09-09 新浪财经 / 第一财经记录了数采路线的代表性分歧,三方观点并列呈现:

观点方立场
无界动力 张玉峰数采工厂场景缺乏真实随机性、数采员无产能驱动,数据质量存疑
星动纪元 席悦真实场景数据飞轮才有效,部署上量周期以月计
北京人形 夏华林闭环先行,单点客户验证通过率 95%+

这场争论没有裁判——三条路线(合成数据 / 真机数采 / 部署回流)分别由银河通用、智元、Figure 重仓,2026 年末前不会有定论。对采购方与研究者而言,正确姿势是把「数据路线」作为评估任何具身厂商时的必问项。


7. 总结

7.1. 优势与局限

本篇的「优势与局限」对应基础设施层的产业判断:优势在于——NVIDIA 全栈已把仿真-训练-部署的工具链打磨到可用且可复制;开源数据集与评测公共品的出现把行业起点整体抬高;国产栈在 Sim2Real 闭环与数据服务上形成本土供给。局限在于——Sim2Real 77 个百分点的差距说明仿真评估远未到「可信替代真机」的程度;真机数据缺口 20 倍且路线未收敛;NVIDIA 源码开源但运行时受控的许可结构埋着供应链依赖;数据主权与安全标准仍是空白。

7.2. 适用边界

本篇对象适用于所有具身智能的开发者与采购方:算法团队选择仿真栈(学术选 MuJoCo / Genesis,工业选 Isaac,LLM 驱动自动化选 Genie Sim 3.0);数据需求方选择数据集与数采服务(公共品 RoboMIND / AgiBot World 起步,专用场景采购数采服务);战略研究者以「数据路线之争」为观察主线。

7.3. 选型建议

  1. 仿真栈选型先问许可:Isaac Sim 源码开源但资产再分发受控,商用再分发前须确认 NVIDIA AI Enterprise 授权。
  2. 数据集起步用开源公共品(RoboMIND / AgiBot World),缺口部分再采购数采服务;采购时以「通过率 95%+ 类」的可验证指标而非小时数计价。
  3. 评估任何具身厂商时把「数据路线」列为必问项:合成数据、真机数采、部署回流三选其一还是组合,直接决定其泛化上限。
  4. 关注 Newton(Linux 基金会治理)与工信部标准体系的进展:物理引擎治理与国家标准的双轨演进,将决定未来三年的工具链格局。

信息缺口声明

  1. Isaac Sim 5.x / Isaac Lab 3.0 官方 release notes 未逐项取得,版本细节以开发者页面与第三方档案交叉验证。
  2. Genesis 官方论文与仓库主 URL:官网重定向至 GitHub(Genesis-Embodied-AI),论文链接未直接核对。
  3. 英伟达 Cosmos 3 官方博客未直接抓取,Cosmos 3 信息以 Analytics Insight 转述为准。
  4. 「50 万小时 vs 1000 万小时」数据缺口为单一综述稿口径(C 级),本文已标注,不宜单独引用。
  5. 国内数据服务市场超 1500 亿元为机构测算口径,无官方统计。
  6. 各国产仿真平台(RealMirror / SimOne 等)的部署客户数与营收均未公开。

8. 参考资料

  1. NVIDIA Isaac — AI Robot Development Platform — NVIDIA Developer,2026。https://developer.nvidia.com/isaac
  2. NVIDIA Isaac Lab — NVIDIA Developer,2026。https://developer.nvidia.com/isaac/lab
  3. Newton, the Next-Generation Open-Source Physics Simulation Engine — NVIDIA Developer,2026(Beta 仓库:https://github.com/newton-physics)。
  4. Best Physical AI Development Tools and Frameworks in 2026 — Analytics Insight,2026。https://www.analyticsinsight.net/amp/story/artificial-intelligence/best-physical-ai-development-tools-and-frameworks-in-2026
  5. Robot SDKs, ROS 2, and Simulation Environments — Kentino,2026。https://kentino.com/ja/blogs/build-guide/robot-sdks-ros-2-and-simulation-environments
  6. NVIDIA Isaac Lab — AI Wiki(软件栈 / 许可 / 硬件要求),2026。https://aiwiki.ai/wiki/isaac_lab
  7. Genesis 开源仓库 — Genesis-Embodied-AI / GitHub,2026。https://github.com/Genesis-Embodied-AI/genesis-world
  8. 北京「数据超级工厂」助机器人理解世界(RoboMIND 2000 万下载)— 人民网北京频道,2026-09-03。https://bj.people.com.cn/BIG5/n2/2026/0903/c14540-41685467.html
  9. 下载超 2000 万次!北京人形加速打造「数据超级工厂」— 搜狐,2026-09-02。https://m.sohu.com/a/1070996577_163278
  10. 天工机器人 8.64 秒背后的「数据力量」— 腾讯新闻,2026-09-02。https://news.qq.com/rain/a/20260902A0B17100
  11. 具身智能数据狂飙,但还未完全实现模型验证 — 新浪财经 / 第一财经,2026-09-09。https://k.sina.com.cn/article_1733360754_6750fc7202001in52.html
  12. 天工 8.64 秒背后的「数据力量」(数据基地五要点)— 具身之家,2026-09。http://www.jushenhome.com/news_d.php?id=1650
  13. Beste Roboter-Simulatoren für RL 2026 — Silicon Valley Robotics Center,2026。https://www.roboticscenter.ai/de/rl-environments/best-2026

Simulation and Data Platform Ecosystem Integration Research


1. Introduction

This piece is the capstone integration article of the 07-Embodied AI Group. Its subject of study is not a single vendor, but the infrastructure layer of Embodied AI: simulation platforms, world models, and datasets / data-collection infrastructure. Every vendor's model iteration in the preceding nine articles — whether 宇树's WVLA, Figure's Helix, or PI's π series — relies on this infrastructure layer to supply training data and evaluation environments. The main axis of differentiation within the group is the "infrastructure layer": whoever controls simulation and data controls the iteration speed of Embodied AI.

1.1. Note on the Integration Article: The Infrastructure Layer

Simulation and data platforms span three layers in the Harness Six-Layer Model: synthetic data generation serves L1 (Context / Training Corpus) and L4 (Data Assets); simulation evaluation is directly the embodied form of L5 (Evaluation and Observation); the licensing system and industry standards belong to L6 (Governance). This article unfolds in four segments — "International Stack — Competing Engines — Domestic Stack — Data Foundation" — and provides a closed-loop view of simulation, data, and training.

1.2. Three-Layer Ecosystem Structure

LayerRepresentativeRole
International StackNVIDIA Isaac / Cosmos / GR00T / OSMO; MuJoCo; Gazebo; Genesis; NewtonThe global de facto standard for simulation engines, world models, and development platforms
Domestic Stack智元 Genie Sim 3.0, 中兴 RealMirror, 无问智科, 51Sim, 光轮智能, 灵初智能, 觅蜂科技Local simulation foundation and data services
Datasets / Data-Collection FoundationRoboMIND (北京人形机器人创新中心), AgiBot World (智元), data-collection factories of each vendorReal-machine data supply and the data industry

2. Glossary

TermEnglish / AbbreviationDefinition
Isaac SimNVIDIA's flagship robot simulator based on Omniverse + PhysX 5, with RTX rendering, supporting digital twins and synthetic perception data
Isaac LabNVIDIA's open-source (BSD-3) robot learning framework; a single GPU can run 4096–8192 parallel environments; 16+ pre-configured robot models
CosmosNVIDIA's world foundation model series (five modules: Curator / Predict / Transfer / Reason / RL), used to generate synthetic training data
GR00TNVIDIA's humanoid robot foundation model and open reference platform, including data pipeline, model, simulation, and Jetson Thor runtime
OSMONVIDIA's cloud-native workflow orchestration platform, chaining together the compute pipeline of "simulation — training — deployment"
Isaac Lab-ArenaNVIDIA's general-purpose robot policy simulation benchmark platform
NewtonOpen-source physics engine under Linux Foundation governance (based on NVIDIA Warp / OpenUSD), co-developed by DeepMind and Disney, supporting differentiable physics
MuJoCo / MJXDeepMind's physics engine and its GPU-accelerated version (MJX), the default choice in academia
GenesisPure Python multi-physics engine (rigid + soft bodies + fluids), 10,000+ parallel environments, independent of the NVIDIA ecosystem
Sim2RealSimulation to RealityTransfer from simulation training to real-machine deployment; per Stanford HAI 2026, simulation success rate 89.4% vs. real home 12%
Real2Sim2RealData pipeline that first reconstructs a real scene into simulation and then closes the loop back to the real machine
Synthetic DataSynthetic DataTraining data produced by simulations / generative models; infinitely scalable and comes with its own labels
Data Collection FactoryData Collection FactoryA facility that primarily uses teleoperation to batch-collect real-machine demonstration data (see 02-agibot.md)
RoboMINDMulti-embodiment manipulation dataset open-sourced by 北京人形机器人创新中心; global downloads have already exceeded 20 million
AgiBot World智元's open-sourced million-scale real-machine dataset, more than 10× the scale of DROID
Bodyless DataBodyless DataGeneral-purpose manipulation data not tied to a specific robot model (觅蜂科技 has accumulated 1 million hours)
Data Impossible TriangleIndustry term: data scale, quality, and cost are hard to satisfy simultaneously
Physical AIThe conceptual domain of "Physical AI" proposed by NVIDIA; listed as one of five strategic pillars at GTC 2026

3. Feature Description and Ecosystem Landscape

3.1. International Stack: NVIDIA as the De Facto Standard

The NVIDIA Isaac platform is the current de facto standard for robot simulation; its official positioning is an "AI Robot Development Platform," composed of simulation (Isaac Sim), robot learning (Isaac Lab), CUDA-accelerated libraries, AI models, and reference workflows. Key capabilities:

  1. Isaac Sim: Omniverse + PhysX 5 + RTX rendering, supporting digital twins and synthetic perception data generation.
  2. Isaac Lab: BSD-3 open-source RL framework, 4096–8192 parallel environments on a single GPU, with RSL-RL / RL-Games / SKRL / SB3 built in, and 16+ pre-configured robot models such as G1 / H1 / Spot / ANYmal / Franka; from 3.0 beta (2026-03) onward, Newton + MuJoCo Warp solvers are optional, and it can be used independently without the Isaac Sim runtime.
  3. Cosmos World Model Series: five modules — Curator / Predict / Transfer / Reason / RL; Cosmos 3 was released at GTC 2026, positioned as a "Physical AI frontier foundation model"; the Physical AI Data Factory Blueprint unifies automated data generation.
  4. GR00T + OSMO + Isaac Lab-Arena: the three-piece set of humanoid foundation model, compute orchestration, and policy benchmark platform.
  5. Ecological position: at GTC 2026, NVIDIA named Physical AI one of its five strategic pillars; by early 2026, 110 robot "brain" developers and industry partners were already building on its stack.

Key licensing points (L6 material): Isaac Sim source code is Apache 2.0, but it depends on the Omniverse Kit SDK and assets, and redistribution requires an NVIDIA AI Enterprise license — a combination of "open-source code, controlled runtime."

3.2. Competing Physics Engines

EngineGoverning BodyCharacteristics
MuJoCo / MJXGoogle DeepMindGPU-accelerated (MJX), the default choice in academia
GazeboROS ecosystemDeeply bound to ROS / ROS 2
GenesisOpen-source communityPure Python, multi-physics (rigid + soft bodies + fluids), 10,000+ parallel environments, independent of NVIDIA
NewtonLinux FoundationBased on NVIDIA Warp / OpenUSD, co-developed by DeepMind and Disney, differentiable physics, Beta already opened

3.3. Domestic Stack

PlatformEntityPositioning
Genie Sim 3.0智元Released at CES 2026-01; the industry's first large-language-model-driven open-source embodied simulation platform
RealMirror中兴End-to-end VLA simulation foundation: data collection – training – inference – evaluation – Sim2Real integrated, zero-shot transfer, 2400+ open-source asset downloads
无问智科无问智科World-model-driven, full-chain Real2Sim2Real closed loop
SimOne 4.051Sim4DGS reconstruction + generative world model
光轮智能光轮智能Simulation – data – evaluation closed loop
灵初智能灵初智能Open-sourced a 1,000-hour full-modality dataset of human hand manipulation
觅蜂科技觅蜂科技1 million hours of accumulated high-quality bodyless data

Accompanying governance action: 工信部 released the 《人形机器人与具身智能标准体系(2026 版)》, the first standard system to cover the entire industry chain.

3.4. Datasets and Data-Collection Foundation

The two major open-source real-machine datasets constitute the public goods of the data layer: AgiBot World (智元, open-sourced 2024-12, million-scale real-machine data, 100+ tasks across five major scenarios, more than 10× the scale of DROID) and RoboMIND (北京人形机器人创新中心, open-sourced 2025-12, 300,000+ dual-arm manipulation trajectories, 700+ practical tasks). On the data-collection foundation side, 北京人形's data base (nearly 6,000 square meters, 40+ simulated real-scene zones, 150+ robots across 40 configurations + 100+ bodyless devices, "matrix-style collection") represents the highest-specification data-collection facility in China at present. Industry data baseline: the whole industry has about 500,000 hours of high-quality real physical interaction data, while a usable level requires about 10 million hours — a gap of about 20× (single review-article caliber, Grade C, citations must be annotated).


4. Platform Architecture

4.1. NVIDIA Full-Stack Layering

NVIDIA's embodied AI stack, from top to bottom, is: Cosmos World Model (data generation) → Isaac Sim / Lab (simulation and training) → GR00T (humanoid foundation model) → OSMO (orchestration) → Jetson Thor (on-device inference); the three hardware platforms DGX / OVX / AGX respectively support training, simulation testing, and deployment. Isaac Lab 3.0 introduces Newton + MuJoCo Warp as optional solvers and supports running independently without Isaac Sim, showing NVIDIA's rebalancing between "platform lock-in" and "open decoupling."

4.2. RoboMIND Data Super-Factory

北京人形机器人创新中心's "data super factory" connects the full closed loop of "collection → cleaning → quality inspection → annotation → training → real-machine evaluation → deployment → reflow" (24-hour automated quality inspection): annual production capacity 180,000 hours, nearly 30,000 hours already delivered, 70% serving industry customers, long-term target 1 million hours. One of its landmark results is that the 天工 robot, supported by the data of this base, ran the 100-meter dash in 8.64 seconds.

4.3. Simulation—Data—Training Closed-Loop Diagram

图 10-1|仿真-数据-训练-真机部署的产业闭环(示意)

仿真-数据-训练-部署闭环与三层供给(示意) 仿真环境 Isaac Sim / Lab Genesis / MuJoCo / Newton Genie Sim 3.0 / RealMirror 数据供给 合成数据(Cosmos) 遥操作真机数据 无本体数据 100 万小时 模型训练 GR00T / GO 系列 / π 系列 Helix / ERA-42 OSMO 编排算力 真机部署 量产本体验证 工况数据回流 闭环 24h 质检 部署工况回流仿真与数据层(Real2Sim2Real / 数据飞轮) 数据集公共品 RoboMIND 下载 2000 万+ AgiBot World 百万真机 评测公共品 Isaac Lab-Arena π0.5 学界基线 治理公共品 工信部标准体系 2026 版 Isaac 许可边界 核心矛盾:行业高质量真机数据约 50 万小时 vs 可用水平需约 1000 万小时(缺口约 20 倍,C 级口径) Sim2Real 差距:机器人操控仿真成功率 89.4% vs 真实家庭 12%(斯坦福 HAI AI Index 2026)

示意:基于本文分析绘制;数据缺口与 Sim2Real 数字为第三方口径并已在正文标注可信度等级。


5. Harness Design

The perspective of the Harness analysis in this article is special: simulation and data platforms themselves are upstream components of other vendors' Harnesses. The following gives observations on the "infrastructure layer" itself across the six layers.

5.1. L1 Context Engineering Layer

Synthetic data and world models are the "pre-training corpus factory" of the embodied field: Cosmos's automated data generation and the Physical AI Data Factory Blueprint are essentially mass-manufacturing scene priors (L1 context) within simulation. Open-source datasets such as RoboMIND / AgiBot World make the context of the real world a public good, lowering the L1 threshold for all downstream models.

5.2. L2 Tools and Execution Layer

Isaac Lab's 4096–8192 parallel environments on a single GPU make "tool execution" possible at tens-of-thousands scale concurrency; Genesis's 10,000+ parallel environments, and the GPU solvers of MuJoCo Warp / Newton, are all doing the same thing — pushing down the trial-and-error cost of physical execution to near zero. The real-machine part of the execution layer (Jetson Thor, Isaac TeleOp) extends the NVIDIA stack downward to the robot body.

5.3. L3 Orchestration and Control Layer

OSMO is the clearest infrastructure product at this layer: cloud-native workflow orchestration, chaining cross-cluster scheduling of data generation, training, evaluation, and deployment — equivalent to a CI/CD pipeline in the embodied AI field. On the domestic side, Genie Studio (智元) plays a similar role (see 02-agibot.md).

5.4. L4 Memory and State Layer

The data base and datasets are precisely the industry-level L4: RoboMIND's "matrix-style collection" (150+ robots across 40 configurations + 100+ bodyless devices) deposits experience in standardized structure; 觅蜂科技's 1 million hours of bodyless data shows that "experience assets decoupled from the robot body" are already scalable in production.

5.5. Evaluation and Observation Layer

This is the infrastructure layer's biggest contribution to the Harness system: Isaac Lab-Arena (general-purpose policy simulation evaluation) and the π0.5 academic baseline (see 08-physical-intelligence.md) constitute the embryo of a benchmarking public good; RoboMIND's "training → real-machine evaluation → deployment → reflow" closed loop turns L5 from a score into an operational process. Stanford HAI AI Index 2026 gives the core metric of this layer — simulation success rate 89.4% vs. real home 12%, a 77-percentage-point Sim2Real gap, showing that there is systematic distortion between the current L5 simulation evaluation and real-machine performance.

5.6. L6 Governance and Safety Layer

Three pieces of governance evidence: Isaac Sim's open-source–commercial boundary design of "source code Apache 2.0, runtime dependencies under controlled licensing"; 工信部's 《人形机器人与具身智能标准体系(2026 版)》 full-industry-chain standard framework; the CR-category compliance practice of the RoboMIND dataset and 24-hour automated quality inspection (data quality governance). Data sovereignty (attribution and cross-border transfer of real-machine scene data) is a governance blank where no standard has yet formed.

5.7. Six-Layer Strength Summary

LayerRatingBasis
L1 Context Engineering★★★Cosmos data factory + public-good-ification of open-source datasets
L2 Tools and Execution★★★Tens-of-thousands-scale parallel simulation + GPU physics solvers
L3 Orchestration and Control★★★Pipeline orchestration of OSMO / Genie Studio
L4 Memory and State★★★Matrix-style collection of the data base + bodyless data assets
L5 Evaluation and Observation★★★Lab-Arena + baseline model + full closed-loop quality inspection (Sim2Real distortion is the biggest gap)
L6 Governance and Safety★★Licensing boundary + national standard system; data sovereignty blank

6. Actual Cases

6.1. RoboMIND: Data Infrastructure with 20 Million Downloads

北京人形机器人创新中心's RoboMIND dataset, since being open-sourced in 2025-12, announced on 2026-09-02 that global downloads had broken 20 million (doubling within one month). Its data base is nearly 6,000 square meters, 40+ simulated real-scene zones, matrix-style collection with 150+ robots across 40 configurations plus 100+ bodyless devices, annual production capacity 180,000 hours, nearly 30,000 hours already delivered, 70% serving industry customers, long-term target 1 million hours; it connects the full closed loop of collection → cleaning → quality inspection → annotation → training → real-machine evaluation → deployment → reflow, with 24-hour automated quality inspection. Relying on the data of the base, the 天工 robot achieved 8.64 seconds in the 100-meter dash. This is the most complete public sample of the "data as infrastructure" narrative.

6.2. Quantitative Evidence of the Sim2Real Gap

Stanford HAI AI Index 2026: robot manipulation simulation success rate 89.4%, real home environment only 12% — the 77-percentage-point Sim2Real gap is the boundary condition that all "simulation evaluation" claims of this group must face head-on. Related to this, the industry's high-quality real-machine data is about 500,000 hours vs. demand of about 10 million hours (20× gap, Grade C single-source caliber), and institutional estimates put the 2026 domestic embodied data services market size at over 150 billion yuan. The two sets of numbers jointly explain why data collection factories (智元, 北京人形, 优必选自贡) appeared densely in 2026: the 77 percentage points that simulation cannot solve, in the short term can only be patched with real-machine data.

6.3. The Three-Sided Debate over Data-Collection Quality

On 2026-09-09, 新浪财经 / 第一财经 recorded representative divergences over the data-collection route; the three sides' views are presented in parallel:

PartyPosition
无界动力 张玉峰Data collection factory scenarios lack real randomness, and collectors have no production capacity drive, so data quality is questionable
星动纪元 席悦Only the real-scene data flywheel is effective; deployment scaling cycles are measured in months
北京人形 夏华林Closed loop first; single-point customer validation pass rate 95%+

This debate has no referee — the three routes (synthetic data / real-machine data collection / deployment reflow) are each heavily invested in by 银河通用, 智元, and Figure respectively, and there will be no conclusion before the end of 2026. For buyers and researchers, the correct posture is to make "data route" a must-ask item when evaluating any embodied AI vendor.


7. Summary

7.1. Strengths and Limitations

The "strengths and limitations" of this article correspond to the industry judgment of the infrastructure layer: the strengths lie in — NVIDIA's full stack has already polished the simulation-training-deployment toolchain to usable and replicable; the emergence of open-source datasets and benchmarking public goods has raised the industry's starting point as a whole; the domestic stack has formed local supply in the Sim2Real closed loop and data services. The limitations lie in — the 77-percentage-point Sim2Real gap shows that simulation evaluation is far from the level of "trusted substitute for the real machine"; the 20× real-machine data gap and the route have not converged; NVIDIA's open-source code but controlled-runtime licensing structure harbors supply chain dependence; data sovereignty and safety standards remain blank.

7.2. Applicability Boundaries

The subject of this article applies to all developers and buyers of embodied AI: algorithm teams choose the simulation stack (academia chooses MuJoCo / Genesis, industry chooses Isaac, LLM-driven automation chooses Genie Sim 3.0); data demanders choose datasets and data collection services (starting from the public goods RoboMIND / AgiBot World, procuring data collection services for specialized scenarios); strategic researchers take the "data route contest" as the main line of observation.

7.3. Selection Recommendations

  1. For simulation stack selection, ask about licensing first: Isaac Sim's source code is open but asset redistribution is controlled; before commercial redistribution, confirm NVIDIA AI Enterprise authorization.
  2. For starting datasets, use open-source public goods (RoboMIND / AgiBot World), and procure data collection services for the gap part; when procuring, price by verifiable metrics such as "95%+ pass rate class" rather than by hours.
  3. When evaluating any embodied AI vendor, list "data route" as a must-ask item: whether to choose one of synthetic data, real-machine data collection, or deployment reflow, or to combine them, directly determines its generalization ceiling.
  4. Pay attention to the progress of Newton (Linux Foundation governance) and 工信部's standard system: the dual-track evolution of physics engine governance and national standards will determine the toolchain landscape for the next three years.

Information Gap Statement

  1. Isaac Sim 5.x / Isaac Lab 3.0 official release notes have not been obtained item by item; version details are cross-verified against developer pages and third-party archives.
  2. Genesis official paper and repository main URL: the official site redirects to GitHub (Genesis-Embodied-AI); the paper link has not been directly verified.
  3. NVIDIA Cosmos 3 official blog has not been directly fetched; Cosmos 3 information is based on Analytics Insight's retelling.
  4. The data gap of "500,000 hours vs. 10 million hours" is the caliber of a single review article (Grade C); this article has annotated it, and it is not suitable for standalone citation.
  5. Domestic data services market over 150 billion yuan is an institutional estimate caliber; there is no official statistics.
  6. The number of deployed customers and revenue of each domestic simulation platform (RealMirror / SimOne, etc.) have not been disclosed.

8. References

  1. NVIDIA Isaac — AI Robot Development Platform — NVIDIA Developer, 2026. https://developer.nvidia.com/isaac
  2. NVIDIA Isaac Lab — NVIDIA Developer, 2026. https://developer.nvidia.com/isaac/lab
  3. Newton, the Next-Generation Open-Source Physics Simulation Engine — NVIDIA Developer, 2026 (Beta repository: https://github.com/newton-physics).
  4. Best Physical AI Development Tools and Frameworks in 2026 — Analytics Insight, 2026. https://www.analyticsinsight.net/amp/story/artificial-intelligence/best-physical-ai-development-tools-and-frameworks-in-2026
  5. Robot SDKs, ROS 2, and Simulation Environments — Kentino, 2026. https://kentino.com/ja/blogs/build-guide/robot-sdks-ros-2-and-simulation-environments
  6. NVIDIA Isaac Lab — AI Wiki (software stack / licensing / hardware requirements), 2026. https://aiwiki.ai/wiki/isaac_lab
  7. Genesis open-source repository — Genesis-Embodied-AI / GitHub, 2026. https://github.com/Genesis-Embodied-AI/genesis-world
  8. Beijing's "Data Super-Factory" Helps Robots Understand the World (RoboMIND 20 million downloads) — 人民网北京频道, 2026-09-03. https://bj.people.com.cn/BIG5/n2/2026/0903/c14540-41685467.html
  9. Over 20 million downloads! 北京人形 accelerates the building of its "Data Super-Factory" — 搜狐, 2026-09-02. https://m.sohu.com/a/1070996577_163278
  10. The "Power of Data" Behind the 天工 Robot's 8.64 Seconds — 腾讯新闻, 2026-09-02. https://news.qq.com/rain/a/20260902A0B17100
  11. Embodied AI Data Soars, but Full Model Verification Has Not Yet Been Achieved — 新浪财经 / 第一财经, 2026-09-09. https://k.sina.com.cn/article_1733360754_6750fc7202001in52.html
  12. The "Power of Data" Behind 天工's 8.64 Seconds (Five Key Points of the Data Base) — 具身之家, 2026-09. http://www.jushenhome.com/news_d.php?id=1650
  13. Beste Roboter-Simulatoren für RL 2026 — Silicon Valley Robotics Center, 2026. https://www.roboticscenter.ai/de/rl-environments/best-2026