实践 — 六层模型在八大行业组的落地


1. 阅读说明与定位

本章是白皮书技术分量最重的两章之一,与第 3 章(架构)衔接:第 3 章回答"第三代 Harness 长什么样",本章回答"它落到八个行业组里,重心如何偏移、瓶颈落在哪层、有哪些已被验证的实践"。

八个行业组为:AI Infra、具身智能、软件工程、硬件研发、知识协同、数据科学、创意产业、风险合规。全部内容基于本项目已产出的调研文档(各行业组 README 与组级 AGENTS.md / SKILL.md),不引入新的外部检索。引用硬数据均与来源文档一致;来源文档标注 [待核实] 的,此处同样标注。

一个贯穿全章的口径(本文判断):同一个六层模型,在不同行业的重心分布完全不同;任何试图用一个通用智能体模板覆盖全部行业的方案,都会在最需要严谨性的地方失效。这正是 AI Harness 作为"工程化承载层"而非"通用框架"的意义。


2. 八组落地总览

2.1. 层重点与瓶颈矩阵

图 2-1|六层模型六大行业组落地:层重点与瓶颈分布

六层模型六大行业组落地:层重点与瓶颈分布 示意:基于本章映射分析绘制 · 强调边框 = 瓶颈最集中的层(L6) L1 · 上下文与检索 重点:知识协同、数据科学 瓶颈:知识协同、风险合规、硬件(封装) L2 · 工具层 重点:硬件研发(最重) 瓶颈:硬件研发(验证)、风险合规(安全) L3 · 编排层 重点:知识协同(为主) 瓶颈:硬件研发(AI Infra) L4 · 记忆与状态 重点:创意产业(最重) 瓶颈:创意产业(一致性)、风险合规(审计) L5 · 评估层 重点:软件工程(最前沿)、硬件研发、数据科学 瓶颈:软件工程、数据科学(静默错误) L6 · 治理层(本图重点) 重点:风险合规(L6 输出即交付物) 瓶颈:知识协同、创意产业、硬件研发 结构解读:同一六层模型,各行业组重心完全不同:软件工程 L5、创意产业 L4、风险合规 L6。 焦点:瓶颈层决定各组第一优先级建设顺序(见 10.2 优先级建议)。

数据来源:基于本文分析绘制的示意图。

下表为基于各组调研文档的映射分析,属本文归纳,非任何标准组织评级。

行业组层重点瓶颈层一句话概括
AI InfraL2(物理底座),贯穿 L1–L6L2(物理上限)+ L5(度量口径)芯片与超节点决定"能做什么"的物理上限;故障常态化与 PUE 红线下,容错编排与能耗成为与算力同级的前置约束
具身智能L2 + L3(大小脑分离实时环)L6(物理安全)+ L5(sim2real 域差距)物理世界的智能体运行时:与软件域共享同一套 Loop 结构,但每一圈的错误代价从"回滚一次部署"变为"损坏设备或伤及一人"
软件工程各层均衡,L5 评估最前沿L5(度量侧尚未越过可信阈值)Harness 的原生域:代码可执行即有天然判定器,但团队对 AI 效果的判断仍停留在主观叙事
硬件研发L2 + L5 最重L2(工具异构、授权受限);L6 代价最高(tape-out 不可逆)EDA 工具不可替代,形式化验证是唯一可判定 ground truth
知识协同L1 + L3 为主L1(检索与上下文边界)+ L6(权限感知检索)组织已知的,如何被可靠地取出来、用起来、管起来
数据科学L1 + L5 为重,ground truth 形态最特殊L5(静默错误不发出声音)AI4S 的 ground truth 是物理定律与实验验证,不是人类标注
创意产业L4 最重L4(跨会话一致性)+ L6(AIGC 标识合规)一致性问题本质上是跨会话、跨镜头、跨集的状态保持问题
风险合规L6 最重L6(可审计、可追溯、人在回路)在这里 L6 不是约束,而是产品:AI 输出会被第三方当作证据审查

2.2. 八组的 ground truth 形态对照

ground truth(判定依据)的形态,是决定各组 Harness 设计差异的第一变量(本文判断):

行业组ground truth 形态判定器可判定程度
AI Infra集群 SLO 达成与作业不中断(机械可测)监控指标、checkpoint 完整性校验、MLPerf 与故障画像基线高(指标即真),但效率结论强依赖基线口径选择
具身智能物理定律 + 真机验收(仿真侧为辅)台架试验(GB/T 43200-2023、GB/T 43199-2023)、LIBERO / HumanoidBench 基准、真机验收仿真侧高,开放世界低,落差即 sim2real 域差距
软件工程测试通过与否(程序化判分)编译器、测试、CI 门禁高,"no partial credit"
硬件研发形式化验证与逻辑等价性检查(LEC)仿真器、形式验证引擎、ATE 机台最硬,数学穷尽证明
知识协同引用可溯源 + 审阅留痕出处指针、审阅人签核中,部分依赖人工
数据科学SQL 结果集比对、物理守恒律、实验复现沙箱执行、物理约束检查、独立实验室高(AI4S 为物理定律),深度研究例外
创意产业一致性指标 + 合规标识校验一致性度量、标识回读校验中低,主观维度依赖 Evaluator + 人工签核
风险合规证据链五元组还原PoV 复现、原文回指、余额重算、人工签字高,但判定权在人与确定性工具

2.3. 八组的验收锚点对照

八组组级 AGENTS.md 分别确立了各自的验收锚点与事实来源,其差异本身就是"层重点差异"在治理端的投影(引自各组组级 AGENTS.md):

验收锚点事实来源主要风险人在回路重点L4 记忆权重
AI Infra集群可用、训练不中断、成本可预期监控与日志(指标即真)生产集群不可逆动作、容量与预算失控、设计数据主权变更窗口审批 + 生产集群破坏性操作双签中(checkpoint 与故障历史)
具身智能仿真先行通过 + 真机人在回路 + 安全认证台架试验与真机验收(物理验证即真)设备损坏与人身安全、sim2real 域差距、遥操作数据合规真机操作全程人在回路;不可逆物理动作一律禁止自主执行高(真机轨迹数据与本体状态)
软件工程可编译、可测试、可部署、可回滚代码与构建结果(可执行即真)越权执行、破坏性操作、供应链计划审批 + 结果评审 + 发布确认低(代码库即外部记忆)
硬件研发形式等价检查通过 + 签核留痕EDA 工具输出(工具判定即真)设计数据泄漏、假收敛、不可逆动作签核 / 流片 / 量产放行人工双签中(回归历史与覆盖率库)
知识协同可溯源、可审阅、可审计语料与知识库(需标注版本)幻觉、越权检索、知识污染事实核查 + 发布审批高(项目记忆是核心资产)
数据科学可复现(ACM 四层定义)+ 口径可溯可执行验证 + 物理定律静默错误、口径漂移、越权可见口径裁定 + 实验预审 + 结果复审高(实验记录与失败库)
创意产业资产可追溯 + 一致性达标 + 标识合规资产库版本 + 校验关卡角色漂移、标识漏打、版权风险创意方向决策 + 具名责任人签核最高(一致性即跨会话状态)
风险合规可举证、可审计、可问责法规条文与证据链合规偏离、证据缺失、数据出域结论复核 + 留痕 + 职责分离中(案例与判例沉淀)

三点读法(本文判断):

  1. 验收锚点沿"可执行性 → 可解释性 → 可问责性"的光谱分布:软件工程在光谱最左端(可执行即可信),风险合规在最右端(可问责才算可信),其余组介于其间。这一分布与各组 L6 权重完全正相关。
  2. 事实来源的权威层级差异,决定了各组 L1 上下文装配的第一优先级不同:软件工程先载入可执行证据,风险合规先载入现行有效规范(带生效日期与效力层级),创意产业先载入资产锚定上下文(不得被裁剪)。
  3. L4 权重与"资产的复用周期"成正比:资产复用周期越长(品牌资产、项目记忆、实验记录),L4 的建设优先级越高;复用周期最短的软件工程组反而把代码库本身当作外部记忆,L4 权重最低。

3. AI Infra 组:L2 执行层的物理底座

3.1. 层重点与瓶颈

AI Infra 组(AI 芯片 / 服务器与超节点 / 集群互联与机房 / 训练框架 / 推理框架 / 运维与可观测)覆盖的是 Harness 六层模型中的 L2 执行层物理底座:芯片与超节点决定智能体"能做什么"的物理上限,训推框架是 L2/L3 的调度中枢,运维与可观测对应 L5 与 L6(来源文档论断)。本组与第 6 章的硬件研发组构成"设计 → 运行"闭环——设计侧的封装(CoWoS、HBM)决定运行侧的显存上限,运行侧的故障画像又反向驱动设计侧的可靠性目标。

本组的结构性张力由三组数据刻画(来源文档,等级已标注):

维度数据含义
规模截至 2025 年末全国已建成万卡智算集群 42 个;全国智能算力规模(FP16)2025 年末 1590 EFLOPS、2026 年 3 月末 1882 EFLOPS(据工信部数据,B 级)规模扩张使硬件故障从异常事件变为常态事件
能耗2025 年我国算力中心用电量 1960 亿千瓦时(同比 +18.1%),预计 2030 年突破 5000 亿千瓦时(中国信通院口径,B 级);四部门要求到 2025 年底新建及改扩建大型/超大型数据中心 PUE 不超过 1.25、国家枢纽节点不超过 1.2(政策原文,A 级)能耗不再是机房专业的后置问题,而是芯片选型与超节点形态的前置约束
可靠性Meta Llama 3 405B 训练的 54 天快照:466 次作业中断中 419 次为意外中断(约每 3 小时一次),意外中断中 GPU 相关占 58.7%(官方技术报告,A 级)容错编排(而非更快的芯片)成为第一工程问题

结论(本文判断):AI Infra 组的全部工程价值,集中在同时优化"算得快""算得起""算得稳"三者——而这三者都不在模型层内,只能由 Harness 的编排、观测与治理层承担。

3.2. 关键实践与案例

案例一:超节点的"逻辑单机化"——L2 执行单元的边界被重新定义(A 级,官方口径)。华为全联接大会 2025 给出本组最凝练的论断:"超节点已经成为主导性产品形态……超节点事实上就是一台能学习、思考、推理的计算机,物理上由多台机器组成,但逻辑上一台机器。"这一表述直接对应 Harness 的 L2:当数百张加速卡通过统一内存编址呈现出"单机"语义时,模型侧的长上下文承载、KV 共享与域内调度都被简化为本地操作——L2 执行层的边界因此从"一卡"上移到"一超节点"。

案例二:CloudMatrix 384 的系统级对标(A 级,论文实测)。在制程受限的约束下,国产路线选择"以系统补单点":以 384 张昇腾 910C 通过 UB 网络互联,形成系统密集 BF16 约 300 PFLOPS 的机架级单元,另有 PDC(Prefill-Decode 解耦)与 EP320 专家并行的工程细节公开于论文(arXiv 2506.12708)。本组统一要求:国产参数引用必须注明是论文实测还是发布会口径,两者证据级别不同。

案例三:MegaScale 的五步容错流水线(A 级,arXiv 2402.15627)。万卡训练的实际可用性取决于"能否把故障从全局事件降级为局部事件":心跳检测 → 自检 → 隔离 → 补位 → checkpoint 恢复。与之呼应,Llama 3 采用异步 checkpoint + 热备节点组合,把有效训练时间维持在较高水平。这一流水线是 L3 编排与 L4 状态记忆在基础设施层的直接体现——容错不是运维动作,而是编排设计

案例四:PUE 红线驱动的形态选择(A 级,政策原文)。PUE ≤ 1.25 / 1.2 的硬指标,使供配电与散热从"机房专业"变成芯片与整机的前置约束:柜间全光互联、无线缆无水管无风扇的中板设计、液冷强制化,都是这一约束的产物。GB200 NVL72 的液冷方案使成本与能耗降低 25 倍(厂商口径,A 级)。

3.3. 落地要点

  1. 故障降级为局部事件:容错编排(检测 → 隔离 → 补位 → checkpoint 恢复)是一等工程能力;衡量口径是有效训练时间占比(ETTR),而非峰值算力。
  2. 能耗与算力同权:能耗预算、PUE 约束、变更窗口必须写进组级 AGENTS.md 的红线清单,与"不可逆动作禁止清单"并列。
  3. 口径标注是可信度基础设施:任何性能数字必须标"官方发布 / MLPerf / 第三方实测 / 厂商宣称"与硬件代际;模糊的"性能提升"表述在组内一律禁止。
  4. 国产化以系统补单点:在制程长期受限的约束下,竞争焦点从单芯片转向系统级(超节点、互联、数据格式)创新。
  5. 最常见失败路径:把 Infra 当作与智能体无关的"机房事项"——事实上它决定了 L1 能装多长的上下文、L2 能跑多复杂的工具链、L5 拿不拿得到可信的效率基线。

4. 具身智能组:物理世界的智能体运行时

4.1. 层重点与瓶颈

具身智能组(大脑 / 小脑 / 伺服电机与执行器 / 材料与传感器)是六层模型解释力最强、同时约束代价最高的一组(来源文档论断)。它的划分有明确政策依据:工业和信息化部《人形机器人创新发展指导意见》(2023-11)把关键技术划为"大脑、小脑、肢体"三大技术群,《人形机器人与具身智能标准体系(2026 版)》进一步以六大板块覆盖全产业链。

本组的核心论断是 「大小脑分离架构」——Harness Loop 在物理世界的直接映射

具身智能方向映射层对应关系
大脑L1 + L3VLM 的感知装配 ≈ 上下文装配;任务分解与技能调度 ≈ Plan-and-Execute
小脑L2 + L3(实时环)以 50–200 Hz 输出动作序列,相当于 Harness Loop 的工具执行环,但时延预算从秒级压缩到毫秒级
伺服电机与执行器L2 物理末端电机/减速器/丝杠是"工具执行"的物理载体;执行器选型 ≈ 工具契约(扭矩/精度/响应)
材料与传感器L1 + L5传感器是"决定模型看到什么"的物理源头,也是观测反馈链路的硬件入口
遥操作与真机数据L4真机轨迹数据集 ≈ 长期记忆与工件库;数据飞轮 = 经验沉淀
仿真与评测L5仿真训练场 = 回归集与 Golden Dataset;sim2real 迁移成功率 = 回归指标
安全规范L6功率与力限制(PFL)≈ 护栏;功能安全分级 ≈ 权限与红线

证据锚点:Figure Helix(2025-02)慢系统 7–9 Hz、快系统 200 Hz;NVIDIA Isaac GR00T N1(2025-03-18)System 2 为 VLM 推理规划、System 1 为 Diffusion Transformer 生成连续动作;反向路线亦存在——银河通用自研"银河星脑"自称"大脑-小脑-神经控制集成于一模"(公司口径)。两种路线并列呈现,本文不预设单一结论。

瓶颈识别(来源文档论断):大脑与小脑的瓶颈在 L5(LIBERO 上的 94%~97% 与开放世界真实成功率之间存在结构性落差;HumanoidBench 等基准只覆盖仿真侧);执行器的瓶颈在 L2(转矩密度、背隙、响应带宽一旦定型,上层算法无法突破);材料与传感器的瓶颈在 L1(传感数据质量决定"看到什么"的物理上限);全组的治理底线在 L6——物理域的错误代价是设备损坏与人身安全,ISO 10218:2025(2025-02 发布、2025-04-01 生效,已并入 ISO/TS 15066 的协作安全要求含 PFL)是本组 L6 锚点标准。

4.2. 关键实践与案例

案例一:仿真先行与数据金字塔(来源文档工程方案)。真机数据极度稀缺(Mobile ALOHA 机身 75 kg、单臂负载 750 g,遥操作采集极慢),因此行业采用"网络视频 → 合成数据 → 真机遥操作"的数据金字塔:GR00T N1 的合成数据带来 +40% 性能增益、真机平均成功率 76.8%(A 级);ALOHA 式低成本主从臂 + ACT 算法可在约 10 分钟内采集约 50 条数据达到 80%~90% 成功率;AgiBot World 提供百万级共享数据集(100 万+ 轨迹、217 任务、100 台同构机器人)。仿真不是替代真机,而是把真机数据的边际价值放大。

案例二:分级数字巧合的显式区分(来源文档论断,全组强制)。团体标准 T/CIE 298-2025《人形机器人智能化分级》采用"四维五级"(感知认知、决策学习、协作交互、执行表现四维;L1 基础执行级至 L5 通用智能级),与 Harness 六层模型的 L1–L6 数字巧合但含义完全不同。全组行文禁止混用,引用时必须写全标准号——这是"术语治理"在 L6 层的具体落地。

案例三:执行器即工具契约(来源文档论断)。绿的三次谐波减速器精度 ≤10 弧秒、扭转刚度提升 2–3 倍(B 级);空心杯电机效率 70%–90%,是灵巧手驱动的主流选择;灵巧手约占人形机器人整机成本 20%–30%。这些硬件指标一旦定型,就直接限定了上层策略的能力边界——执行器选型的本质是写"工具契约"

案例四:口径冲突的并列呈现(来源文档论断)。谐波减速器全球份额存在 40% / 75% / 80% 三个悬殊口径;2025 年全球人形机器人出货存在 1.6 万台、近 1.8 万台(同比 +508%)等多套口径。本组统一要求:关键份额与规模数据一律标注统计口径与来源性质,多口径并列呈现、不做合并。

4.3. 落地要点

  1. 物理世界安全红线:仿真先行 + 真机操作全程人在回路;禁止自主执行不可逆物理动作。这是与软件工程组"沙箱 + 审批"本质不同的硬约束——错误代价是物理损坏与人身安全。
  2. 安全规范即 L6 锚点:ISO 10218-1/2:2025(含 PFL 功率与力限制);执行器试验依据 GB/T 43200-2023;六维力标校依据 GB/T 43199-2023;腿式机器人性能试验依据 GB/T 44251-2024。规范引用必须写全标准号与版次。
  3. 基准与真机双报告:只报仿真基准成绩(LIBERO / HumanoidBench)不足以证明能力,必须同时报告真机验收结果;sim2real 迁移成功率是核心回归指标。
  4. 数据资产化:真机轨迹、标定记录、策略检查点属长期资产,必须有唯一标识、版本与责任人;遥操作数据须合规采集与使用。
  5. 警惕分级术语混淆:T/CIE 298-2025 的 L1–L5 与 Harness L1–L6 必须显式区分;这是本组最容易出现、也最容易扩散的表述错误。

5. 软件工程组:原生域与 L5 最前沿

5.1. 层重点与瓶颈

软件工程组是 AI Harness 全部行业图景中唯一的概念原生域——Harness 一词直接借自软件工程的 Test Harness。六层在本组均衡发展,但L5 评估最前沿:代码有编译器、测试与 CI,是当前唯一大规模落地了"程序化判分"的智能体场景。

本组的结构性张力由三个数据刻画(A 级来源):

数据含义
SWE-bench Verified 上 Claude Opus 4.6 于 2026-02-05 取得 80.8%,成为该榜首个突破 80% 的模型;Terminal-Bench 2.0 上 Claude Sonnet 4.5 于 2025-09-29 取得 51.0%,成为该榜首个突破 50% 的模型能力侧已越过可用阈值
DORA 2025(2025-11-12)显示 90%+ 开发者已在工作中使用 AI;Stack Overflow 2025 显示 84% 正在使用或计划使用采用侧已越过普及阈值
METR 随机对照试验(2025-07-10):资深开源开发者使用 AI 后实测慢 19%,自评快 20%;DORA 2025 显示开发者自评生产力 +80%度量侧尚未越过可信阈值

结论(本文判断,沿用来源文档):能力与采用都已到位,AI Harness 在软件工程领域的全部剩余价值,几乎都集中在补齐度量侧这一环

5.2. 关键实践与案例

案例一:OpenAI 百万行代码实验(A 级)。2025-08 下旬对空仓库首次提交,脚手架由 Codex CLI + GPT-5 生成;五个月后约 100 万行代码,约 1,500 个 PR,3 名工程师(后扩至 7 名),人均日 PR 3.5,时间成本约为手写的 1/10,人类手写代码 0 行,单任务最长超过 6 小时。六项关键决策(AGENTS.md 约 100 行作目录、linter 错误消息写成修复指令、doc-gardening agent、依赖链机械强制、可观测性对 agent 开放、最小阻塞合并)分别落在 L1 / L6→L1 / L6 / L6 / L5→L1 / L3,详细拆解见第 3 章 10.2 节。

案例二:Anthropic 长时运行 Harness 两代解法(A 级)。从 Initializer + Coding Agent 双 Agent 分工(交接包 + 开场三步 + 干净状态收尾),到 Planner / Generator / Evaluator 三角色(Sprint Contract + 独立 Evaluator + 硬阈值),展示了 L3 / L4 / L5 的协同设计。

案例三:METR 对照试验的度量教训(A 级)。实测慢 19% 与自评快 20% 的背离说明:自评度量的是"写代码这一段"的体感速度,实测度量的是端到端吞吐;AI 把前者压缩的同时放大了验证、审查与处理"几乎对但不完全对"产物的成本。Stack Overflow 2025 中 66% 受访者把"AI 方案几乎对但不完全对"列为最大挫败——这不是能力问题,而是可验证性问题

案例四:scaffold 差异的量化(B/C 级)。同一模型在不同 Harness 上分差 2~14 个百分点;LangChain 仅改 Harness(同模型、同 API)从 52.8% 提升到 66.5%,五项改动全部不涉及换模型。

5.3. 落地要点

  1. 双层门禁:产物门禁(可编译、可测试、可部署、可回滚)与过程门禁(轨迹评估、步数上限、权限命中检查)并存,缺一不可。
  2. 统一度量到端到端:以 DORA 四指标为锚,禁止以代码行数、补全采纳率作为效果结论;任何效率结论必须有对照测量。
  3. 验收锚点:可编译、可测试、可部署、可回滚;过程证据(Trace、评分卡、人工确认记录)随变更归档。
  4. 最常见失败路径:跳过 Eval 直接建设 Coding——没有回归集与轨迹评估,每次提示词改动都是"凭感觉"。

6. 硬件研发组:L2 与 L5 最重,L6 代价最高

6.1. 层重点与瓶颈

硬件研发组是最能检验"Harness 是否真的把模型的不确定性转化为工程可预期性"的试金石,因为它同时具备两个极端特征(来源文档论断):

  1. 反馈闭环最贵:一次先进节点 tape-out 的代价以亿美元计(IBS 估计 5nm~3nm 单颗 2 亿~5 亿美元以上,B 级),设计错误无法像软件那样热修复——这把 L6 治理推到最高优先级。
  2. ground truth 最硬:仿真器、形式验证引擎、ATE 测试机、量测设备都能给出确定性的通过或失败判定——这使 L5 不需要"额外搭建",而应直接复用覆盖率数据库、回归农场与形式证明。

L2 层面的核心论断:EDA 工具不可替代,智能体的正确姿势不是"取代引擎",而是"编排引擎"。Cadence ChipStack 在 NVIDIA OpenShell 沙箱内编排 Xcelium(动态仿真)与 Jasper(形式验证);Siemens 自建 MCP 服务器把 Questa One 引擎能力暴露给智能体框架,并明确强调"挂钩现有仿真引擎而非替换它们"。

L5 层面的核心论断:形式化验证与逻辑等价性检查(LEC)是唯一可判定的 ground truth。任何 AI 优化后的网表,必须与黄金 RTL 做形式等价性检查,确认功能行为未改变,才可进入后续流程。

各方向瓶颈层分布:01 芯片设计在 L5(设计反馈周期长、代理指标与真实性能脱节);02 芯片验证在 L2(工具链异构、引擎授权受限);03 封装在 L1(多物理场、多厂商异构数据难以统一表达);04 测试在 L6(良率数据属核心资产,禁止出企业边界);05 AI Infra 在 L3(万卡规模下故障成为常态)。

6.2. 关键实践与案例

案例数据来源等级
Cadence Cerebrus最高 10 倍生产力 + 20% PPAA(厂商口径)
Cadence ChipStackNVIDIA 内部验证周期提速 40 倍以上;前端设计验证最高 10 倍A(厂商口径)
Siemens Questa One覆盖加速 50 倍A(厂商口径)
AI 赋能 EDA 设计成本节省Semico Research 预测 20%~30%;14nm SoC 代表性实测 21.3%B
行业 AI 设计工具支出2023 年 3 亿美元,年增 20%,2026 年超 5 亿美元(Deloitte TMT Predictions)B
验证占项目周期比例60%~70%(复杂 SoC)B
GB200 NVL72 液冷使成本与能耗降低 25 倍A(厂商口径)

基准落差与防作弊(来源文档论断三):VerilogEval v2 上 GPT-4o 的 spec-to-RTL pass@1 为 63%;但据公开演讲整理,更贴近生产的 CVDP 基准上成绩降至 10%~40%,最难的 RealBench 至今无 AI 系统解出任何一题(C 级)。因此本组要求:禁止只报学术基准成绩,必须同时报告项目内真实回归指标。此外,尚未检索到覆盖"工具调用 + 多轮调试 + 覆盖率收敛"全流程的 EDA Agent 公开基准——这是一个真实且重要的行业空白,导致本域无法像软件工程依赖 SWE-bench 那样横向比较不同 Harness 实现,只能依赖企业内部私有回归集。

6.3. 落地要点

  1. 以 EDA 引擎为唯一裁判:模型只产出候选解;所有候选解在进入签核前必须通过形式等价性检查;模型不得自我判定"应该没问题"。
  2. 人类在环 + 强沙箱 + 强审计:流片、签核、量产放行等不可逆动作必须人工确认 + 双签,智能体默认无直接触发权限;自主智能体必须运行于沙箱运行时(NVIDIA OpenShell 范式:策略控制、隔离、对工具与设计数据的受控访问)。
  3. 设计数据不出边界:RTL、网表、版图、测试程序、良率数据属企业核心 IP,按 IEEE 1735-2023 做 IP 加密与管理。
  4. 覆盖率不可凑数:区分代码覆盖率与功能覆盖率、识别不可达 bin,否则出现"覆盖率 100% 但仍有设计漏洞"的假收敛;LLM 生成的 SVA 断言必须由形式化工具验证。

7. 知识协同组:L1 与 L3 为主

7.1. 层重点与瓶颈

企业落地大模型的第一批真实场景,绝大多数不是写代码,而是:找一份文档、答一个问题、起草一份材料、处理一张工单、跑通一条流程。这些场景的能力瓶颈不在模型本身,而在模型与组织既有知识资产、流程资产之间的承载层(来源文档论断)。

七个方向(Projects / Works / Docs / RAG / Knowledge / Workflow / BPM)构成"信息可达 → 工作可编排 → 流程可治理"的三层递进,对应 L1 上移到 L3、再到 L6 的路径。瓶颈有二:

  • L1(检索与上下文工程):检索质量决定生成质量的上限;结构化知识对复杂查询是必需的而非可选的;长上下文不能替代上下文工程。
  • L6(权限感知检索):权限必须落在检索层,而不是仅落在应用层。

7.2. 关键实践与案例

案例一:Contextual Retrieval 的工程收益(Anthropic 官方,A 级)。在 recall@20 口径下,基线检索失败率 5.7%;采用 Contextual Embeddings 后降至 3.7%;叠加 Contextual BM25 后降至 2.9%;再叠加重排后降至 1.9%,官方表述为"reduce the number of failed retrievals by 49% and, when combined with reranking, by 67%"。预处理一次性成本约 $1.02 / 百万文档 token。这一收益来自工程层而非模型层

案例二:结构化知识的量级提升(data.world 自研基准,A 级口径但注明局限)。43 个业务问题上,裸 LLM 平均执行准确率仅 16.7%,其中"指标与 KPI"与"战略规划"两类高 schema 复杂度问题为 0%;接入知识图谱后准确率提升至 3 倍;叠加 OBQC(Ontology-based Query Check)与 LLM Repair 后达 72.55%,相对纯 SQL 提升 4.2 倍。需注意:该基准为 43 题、13 张表、单一保险领域、GPT-4 零样本,未经大规模第三方复现,应视为自研方法的上限参考。

案例三:长上下文的物理局限(学术论文,A 级)。Lost in the Middle(Liu et al., TACL 2024):多文档问答呈 U 形曲线,某些配置下把相关信息埋在中部,表现甚至低于闭卷——召回的上下文是净负收益。RULER(NVIDIA,COLM 2024):17 个长上下文模型中只有约一半能在 32K 维持令人满意的表现。NoLiMa(ICML 2025):13 个宣称支持 ≥128K 的模型中 11 个在 32K 就跌破自身短上下文准确率的一半;GPT-4o 从 99.3% 降到 69.7%。

案例四:权限继承的双刃剑(GOV.UK 官方报告,A 级)。英国政府 M365 Copilot 跨部门试验:工具"adopts the permissions of the end user and will only retrieve documents that a user could normally access",同时官方警告"Copilot's ability to search and query using a user's access may highlight issues when users have access to files they shouldn't"。结论:权限继承不是"配置完就安全",而是会放大既有权限配置错误

7.3. 落地要点

  1. 检索先行,生成在后:没有召回支撑的断言一律不输出("无源不答");为检索链路设定 Recall@K 评测门控,检索策略变更先跑分再上线。
  2. 小语料豁免:知识库小于 200,000 tokens(约 500 页)时可直接全量入提示词,无需 RAG(Anthropic 官方原文);超过则必须走检索链路。
  3. 权限感知检索:在检索层做结果过滤,密级作为索引字段而非事后标签;定期以"越权检索用例"做红队测试。
  4. 标准缺位是常态,评测集是补位手段:七方向中仅 Knowledge(ISO 30401:2018)与 BPM(BPMN / CMMN / DMN / IEEE 1849 / OCEL 2.0)有正式标准;RAG、Docs、Works 无对应 ISO/IEEE 正式标准,应建立组织内部 Golden Dataset 与门控阈值。
  5. 最常见失败路径:跳过第一层(信息可达)直接建设第三层(流程治理)——没有可信的检索与知识治理,流程自动化只会把错误规模化。

8. 数据科学组:AI4S 的 ground truth 是物理定律

8.1. 层重点与瓶颈

数据科学组任务有三个结构性特征(来源文档论断):产物不是文本而是可执行的断言(一条 SQL、一次模拟、一份因果估计都运行在真实系统上,可直接被验证或证伪);错误是静默的(一条崩溃的管道会立刻告诉你它坏了,一条算错的管道什么也不会告诉你);约束来自外部世界(权限由数据分级决定、正确性由物理定律或业务口径决定、成本由算力配额决定)。

六个方向的六层侧重差异极大:01 数据工程在 L1 + L6;02 数据分析在 L1 + L5;03 深度研究在 L1 + L3;04 科学计算在 L2 + L4;05 高性能计算在 L2 + L3;06 科学发现(AI4S)在 L5 + L3。其中最本质的差别在 L5:AI4S 的 ground truth 不是人类标注,而是物理定律、实验验证与守恒律约束

8.2. 关键实践与案例

案例一:阿贡国家实验室 Aurora 智能体材料筛选——"LLM 从不接触调度器"。在 Aurora 上的智能体材料筛选工作中,MCP 工具不直接跑模拟,而是 emit Parsl applications,由 Parsl 负责放置、并发与容错。这是 L2 与 L3 分离的最佳实证,确立了本域默认架构:智能体不应直接调用调度器,而应产出可被工作流引擎承载的作业描述

案例二:静默错误的代价(来源文档论断)。一条算错的管道不报错、带着格式正确的数字与图表出现;一条幻觉的综述带着引用格式完整体面地出现。对策不是更强的模型,而是:语义回归集 + grain 断言 + 独立复算 + 结果集比对,而非仅依赖行数与新鲜度。有公开报道指出(二手转述),仅 9% 的数据工程师对通用 AI 工具生成的 Airflow DAG 表示满意,根因是模型缺少项目 DAG、执行环境与既有约定这些上下文。

案例三:评估成本与分层评估。单次科学模拟可达 1,600~4,400 秒,无法高频回归;对策为分层评估:廉价代理指标先行,昂贵验证按需触发,代理指标与真值定期校准。另有研究报道,用云端 API 服务调度 100 个作业需 1~2 小时,限制实时部署——对策是推理与约束强制分离:模型负责推理,确定性模块负责可行性与安全。

案例四:可复现性四层定义作为验收口径。ACM 对可复现性给出四层术语:Repeatability / Replicability / Reproducibility / Reusability;Harness 的 L4 应直接以这四层为记忆结构设计的验收口径——输入数据版本可追溯、执行环境可重建、随机种子可控、结论可重算。

8.3. 落地要点

  1. 不把"看起来对"当"对":可执行验证(SQL 比对、物理守恒律检查、独立复算)做一等公民;分析类任务配 verified queries 回归集,除执行准确率(EX)外还要看有效效率得分(VES)——通过全表扫描返回正确行的查询是等着发生的生产事故。
  2. 数据分级是硬边界:RLS/CLS、PII 脱敏、跨境限制在 L6 强制执行;模型永远不应成为权限的判断者
  3. 复用而非重造编排:Airflow / dbt / Parsl / Slurm 是数据科学的原生编排形态,Harness 的价值在于把自然语言目标翻译成这些引擎能消化的作业图。
  4. ground truth 缺失时的退守方案:深度研究方向无标准答案,采用引用可核查率硬性 DoD、外部基准、评审智能体分级 + 人工监督。

9. 创意产业组:L4 最重,一致性即跨会话状态

9.1. 层重点与瓶颈

创意产业组六个方向(智能制造 / 工业互联网 / 媒体 / 创意设计 / AI 网剧 / AI 动画)按交付物的可判定性差异分为两类(来源文档论断):

  • 内容侧(媒体、创意设计、AI 网剧、AI 动画):交付物是内容资产,判定标准中很大一部分是"是否还是同一个人、同一个品牌、同一个调性"——这是一类跨会话、跨镜头、跨集的状态保持问题,因此 L4 记忆与状态层是质量瓶颈
  • 工业侧(智能制造、工业互联网):交付物是物理世界的状态改变,判定标准是良率、漏检率、停机时长等物理量,因此 L5 与 L6 是落地瓶颈

两组共享同一套 L6 基线:《人工智能生成合成内容标识办法》(国信办通字〔2025〕2 号)自 2025 年 9 月 1 日起施行,要求生成合成内容添加显式标识与隐式标识;第九条要求相关日志记录留存不少于六个月;第十条明确禁止恶意删除、篡改、伪造、隐匿标识。合规义务已经下沉到元数据字段与导出脚本这一级——"写元数据""打角标""留日志"不再是运营动作,而是 Harness 的 L2 工具契约与 L6 治理红线

9.2. 关键实践与案例

案例一:可口可乐假日营销——"片段质量"与"成片质量"之间的工程鸿沟。2025 年假日营销中,5 名 AI 专家在 30 天内精修超过 70,000 个视频片段(据幕后报道,非官方披露),才把生成式视频模型拉到可播出标准;而 2024 年版因人物形体扭曲受到广泛批评。这说明生成模型输出的片段质量与成片质量之间存在巨大的工程鸿沟,填补这道鸿沟的正是 Harness

案例二:规模越过人工兜底的临界点。据中国网络视听协会《微短剧创作指引》(引自人民日报,2026),2026 年一季度全行业上线微短剧约 12.8 万部,其中 AI 微短剧约 12.2 万部,占比超 95%。在这一量级上,任何依赖人工逐条复核的质量体系都会失效,必须把一致性校验、标识校验、前置审核做成流水线上的自动关卡。

案例三:确定性操作脚本化。Anthropic 对 Agent Skills 的说明给出工程原则:让模型逐 token 生成排序结果远比直接运行排序算法昂贵,且很多应用需要"只有代码才能提供的确定性可靠性"。对创意产业而言,抽帧、色彩校正、元数据写入、标识校验、印刷文件导出这类操作应封装为脚本,而不是交给模型生成

案例四:资产锚定与镜头状态机(来源文档工程方案)。角色资产库(三视图 + 表情集 + 色卡 + 音色)与镜头状态机是 AI 网剧 L4 的核心结构;一致性问题的根因通常是锚定信息在第 N 次会话被挤出了上下文——因此资产锚定上下文不得被裁剪。一致性指标(ArcFace / DINO-I / CLIP-I、滑步抖动率等)与跨帧注意力、时序记忆模块是 AI 动画侧的判定与抑制手段。

9.3. 落地要点

  1. 资产管理壳化:每个资产(角色、品牌、IP、设备孪生)必须有唯一标识 + 版本号 + 授权状态 + 责任人;无版本号的资产视为不可用;跨会话连续性由状态载体保证,不由模型记忆保证。
  2. 标识合规自动化:在导出脚本中固化元数据写入与角标渲染;导出后自动回读校验;去标识操作列为禁止事项。
  3. 版权与肖像权红线:素材授权台账;角色库仅使用授权或自有人物形象;前置审核。
  4. 责任分工:AI 是执行与制作的超能力,创意方向与思想领导由人主导;任何最终对外发布的内容必须由具名人类责任人签核。
  5. 效果指标注明口径:大量效果数据为厂商自述或第三方估算,引用时统一采用"据具体披露方披露""第三方估算"表述,不提升为断言。

10. 风险合规组:L6 最重,可审计、人在回路、证据链

10.1. 层重点与瓶颈

风险合规组(金融 / 合规 / 法务 / 审计 / 安全)是八组中 L6 权重最高的一组,因为其共同点不是"用 AI 提效",而是:AI 的输出会被第三方(监管机构、司法机关、客户、对手方、攻击者)当作证据来审查。在其他组里 L6 是约束条件;在本组里,L6 的输出物本身就是交付给监管、董事会、法庭的最终交付物(来源文档论断)。

三条主线贯穿全组:

  • 可审计:外部审查的不是"模型好不好",而是"你当时依据什么做出这个判断、依据是否真实、过程是否可重现"。
  • 可追溯:数月乃至数年后被抽检时,必须能还原到当时的语料版本与规则版本——语义相似度检索无法区分"现行有效"与"已废止",必须做效力层级与时间效力的结构化过滤。
  • 人在回路:本组大量动作具有不可逆性(放款、报送、签署、封禁),不可逆动作绝不能由模型自主执行。

各方向瓶颈层:Finance 在 L1(过期行情/过期财报进入上下文是最危险的失效模式);Compliance 在 L1(引用已废止或尚未生效的法规版本是最严重事故);Legal 在 L1 + L2(效力层级过滤 + OCR 版面解析决定下游一切质量);Audit 在 L4(工作底稿本质是"过程证据的持久化");Security 在 L2(唯一允许在限定范围内执行破坏性动作的方向)。

10.2. 关键实践与案例

案例一:AIxCC 范式——模型不确定性如何被工程可判定性调和(DARPA 官方,A 级)。DARPA AI Cyber Challenge 决赛(2025-08,DEF CON 33):七支队伍的 Cyber Reasoning System 在 5400 万行代码上,漏洞识别率从半决赛 37% 升至决赛 86%,修补率从 25% 升至 68%;63 个挑战中发现 54 个唯一合成漏洞,其中 43 个被成功修补;额外发现 18 个真实 0day(11 个提供补丁);平均每项竞赛任务成本约 152 美元。冠军 Team Atlanta(ATLANTIS,400 万美元)。

对 Harness 而言,真正有价值的不是数字,而是七支队伍收敛出的共同架构:LLM 不做漏洞挖掘,它编排做挖掘的工具并解释结果;漏洞以可复现的 PoV(Proof of Vulnerability)确认,而非模型的"直觉"。识别率 37% → 86% 的跃升,不是因为模型变强,而是因为编排层学会了何时调用哪个确定性工具、以及何时放弃一个假设。这一范式向全组推广为"判定权归属的通用原则":假设生成归模型(允许猜错)、证据获取归确定性工具(行为可重复)、事实判定归确定性工具 + 人工(判定必须可复现、可追责)。

案例二:先检测、后自动响应的实证。CyberSentinel-LLM(Computers, Materials & Continua vol.89 no.1, 2025)在 HDFS 日志流上的调研显示:8 名 SOC 分析师对"重复性分诊工作减少"的评分达 4.6/5.0,但对自主响应建议的信任度仅 3.9/5.0——能力认可高于信任度,是渐进授权路线最直接的实证。Google Big Sleep 的实践与之呼应:所有发现在披露前均由 Project Zero 分析师验证(2025 年基于威胁情报发现的 SQLite 漏洞 CVE-2025-6965,CVSS 7.2,即按此流程处理)。

案例三:AI 自身成为被攻击与被审计对象(IBM《Cost of a Data Breach Report 2025》,2025-07-30,A 级):13% 的组织报告其 AI 模型或应用遭到泄露,另有 8% 不确定;在被攻陷的组织中,97% 报告未部署 AI 访问控制;63% 的被攻陷组织要么没有 AI 治理政策,要么仍在制定中;五分之一的组织报告因影子 AI(Shadow AI)发生泄露。对策:AI 资产台账化(AI BOM)、AI 遥测日志、护栏与最小权限。

案例四:证据链五元组作为法定义务的工程实现(来源文档方案)。每次输出强制绑定:输入快照 + 工具调用日志 + 输出 + 人工确认记录 + 哈希。这与《生成式人工智能服务管理暂行办法》第十九条的说明义务在结构上同构;中国注册会计师协会 2026-03-05 风险防范提示要求在审计工作底稿中充分、适当地记录 AI 使用过程与结果。验收口径:任意一条历史结论,能在 10 分钟内还原"当时看到了什么、用了哪个规则版本、哪个模型版本、谁批准的"。

10.3. 落地要点

  1. 责任不可转移:中注协"不减轻注册会计师对审计意见承担的责任"、最高人民法院"作出司法裁判和承担司法责任的主体是审判人员"、HKMA "technology does not replace governance"——本组的 Harness 设计目标不是"替代人",而是"让人能够负责"。
  2. 判定权不能交给概率:禁止把模型输出当作已核实事实;引用必须返回原文片段与出处;未命中检索结果时输出"未检索到依据"而非推测。
  3. 职责分离(SoD):依据 GB/T 45654—2025 第 4.3.1 条"在同一项标注任务中,标注执行人员和标注审核人员不应由同一人员承担",生成者 / 审核者 / 证据保管人三类身份必须分离,不得共用同一身份与凭证。
  4. 人工确认是留痕动作而非布尔开关:必须带身份、带时间戳、带确认内容快照;触发条件外部化为清单(金额阈值、不可逆动作、跨法域、监管报送),不依赖模型自我判断。
  5. 数据出域控制:未经客户授权或法律法规允许,不得将涉密信息输入公共 AI 平台(中注协 2026-03-05);数据分级标签 + 出域拦截 + 脱敏 + 最小必要采集。
  6. 慢是设计目标,不是缺陷:如果说软件工程组的 Harness 追求"更快地产出可验证变更",那么本组的 Harness 追求的是"更慢但可被举证地做出可追责判断"。

11. 跨行业共性模式提炼

八个行业组的实践虽然重心各异,但收敛出四个可跨行业迁移的结构性模式(本章归纳,为全文观点部分)。

11.1. 模式一:确定性工具充当判定器范式

行业组确定性判定器模型允许的不确定性
软件工程编译器 + 测试 + CI(程序化判分)候选解可以错,判分不可错
硬件研发形式验证 + LEC + ATE候选网表可以错,等价性证明不可错
数据科学SQL 比对 + 物理守恒律 + 独立复算假设可以错,复算结果不可错
风险合规(Security)PoV 可复现崩溃确认假设可以错,PoV 不可错
创意产业标识回读校验 + 一致性度量风格可以变,合规校验不可变

这一范式的通用表述(本文判断):把任务分解为"假设生成(模型,允许高不确定性)—证据获取(确定性工具,行为可重复)—事实判定(确定性工具 + 人工,零不确定性)"三段,判定权永远不落在模型概率上。AIxCC 的识别率跃升(37% → 86%)与本模式互为印证。

11.2. 模式二:人在回路的分级设计

八个组的共同教训:人在回路不是一个开关,而是一组需要被设计的断点位置;断点放错位置,回路退化为橡皮图章。共性设计包括:

  • 确认点前置:在智能体开始执行前确认方案与影响面,而非在写完后确认结果(软件工程组);知识上架、文档定稿、流程发布前置审批(知识协同组)。
  • 按风险分级设置断点:低风险自动放行、中风险人工评审、高风险人工审批 + 回滚预案、不可逆双人确认(软件工程组五级分级);Security 方向在预授权沙箱范围内允许自主执行,其余需审批。
  • 确认是留痕动作:带身份、带时间戳、带确认内容快照(风险合规组)。
  • 生成者与审核者分离:独立 Evaluator(软件工程组)、生成者/审核者身份分离(风险合规组)、断言由形式化工具验证而非"生成即通过"(硬件研发组)——本质同源:评估者与被评估者分离

11.3. 模式三:资产状态管理即 L4

不同行业对"什么必须被记住"给出了不同答案,但答案的结构惊人一致——跨会话连续性由外部状态载体保证,不由模型记忆保证

行业组"资产"是什么状态载体
软件工程代码 + 进度 + 功能清单git 历史 + 进度文件 + JSON 清单
硬件研发设计意图 + 覆盖率 + 回归历史覆盖率数据库 + 历史回归库 + 知识图谱(设计意图)
知识协同文档版本 + 项目记忆doc_id + 版本快照 + 项目级记忆摘要
数据科学notebook 状态 + 数据版本 + 失败实验数据快照 + 实验记录(含失败原因分析)
创意产业角色三视图 + 品牌规范 + 镜头状态资产库(唯一标识 + 版本 + 授权状态)+ 镜头状态机 + 数字主线
风险合规底稿 + 取证链append-only 审计轨迹 + Chain of Custody

通用原则(本文判断):每个资产必须有唯一标识、版本号与责任人;资产变更必须留痕;无版本号的资产视为不可用。创意产业组的"一致性 = 跨会话状态保持"是这一模式最直观的表述。

11.4. 模式四:证据链即 L6

当 AI 输出需要面对外部审查时,L6 的产出物从"约束记录"升级为"交付物本身"。风险的等级越高,证据链的完整度要求越高:

行业组证据链形态外部审查者
软件工程变更说明五段 + Trace + 评分卡代码评审者、审计方
硬件研发工具名 + 版本 + 命令 + 日志 + 数值 + 种子签核工程师、车规审核方
创意产业标识位置 + 写入者 + 回读校验记录监管机构
风险合规五元组(输入快照 + 工具日志 + 输出 + 人工确认 + 哈希)监管、法庭、董事会
数据科学数据版本 + 环境 + 种子 + 复算脚本同行评审、期刊

通用原则(本文判断):证据链的最小单位是"输入快照 + 过程日志 + 输出 + 人工确认 + 哈希"五元组;验收口径是"任意一条历史结论能在固定时间内还原当时状态"。审计留痕、append-only、职责分离是三件标配。


12. 落地路径与分期建议

以下为基于八组实践的分期建议(本章归纳,非标准组织的路线图)。

12.1. 分期总表

阶段目标建设重点验收标志
第一期:判定与度量先让"做得好不好"可判定每个任务定义可判定的验收标准;建立最小回归集;Trace 全量可回放团队能回答"这次改动变好了还是变坏了"
第二期:边界与治理让执行有边界工具副作用分级;沙箱执行;凭据保护;预算护栏;权限按任务授予破坏性动作默认拒绝且可审计;成本可预期
第三期:状态与编排让长任务可交接交接包(进度 + 清单 + 检查点);Sprint Contract;长任务恢复跨会话任务不失忆、不重复已完成工作
第四期:闭环与自治让系统自我改善评估反馈回流上下文;文档自动治理(doc-gardening 类);错误消息即修复指令Harness 自身进入可回归状态

12.2. 按行业组的优先级建议

行业组第一优先依据
软件工程L5(回归集 + 轨迹评估)度量侧是全部剩余价值的所在;跳过 Eval 建设 Coding 是最常见失败路径
硬件研发L6(沙箱运行时 + 人在环)tape-out 不可逆;治理代价最高的组必须先立治理
知识协同L1(检索评测门控 + 权限感知检索)没有可信检索与权限边界,后续一切自动化放大错误
数据科学L5 + L6(可执行验证 + 数据分级)静默错误与越权可见是两大主风险,且都可被工程手段直接消除
创意产业L4(资产库 + 一致性校验关卡)一致性是质量瓶颈;规模已越过人工兜底临界点
风险合规L6(证据链五元组 + 职责分离)L6 是交付物本身;缺证据链的交付不完整

12.3. 通用注意事项

  1. 先定契约,再定验证,最后才谈能力(软件工程组写作主线,可推广至全行业):任务契约、完成定义、验证方式先行,模型能力只决定上限不决定下限。
  2. 不要让安全机制有静默降级路径:沙箱起不来就拒绝运行(failIfUnavailable 硬失败思路),而不是悄悄降级。
  3. 规则要少而可机械强制:当指令文件写得太长,agent 会像人一样跳过阅读;"过多指导变成无指导"(OpenAI 官方归纳)。
  4. 警惕 Harness 过度复杂化:模型在后训练阶段与特定 Harness 联合训练已成事实(Anthropic 官方指出改变工具逻辑反而可能让模型表现变差),过度复杂的 Harness 可能被下一次模型升级直接抹平。
  5. 每半年做一次六层成熟度自评(见第 3 章 12 节):优先关注最弱层而非平均分;层间差距 ≥ 2 级即存在结构性短板。

13. 总结

八组实践共同验证了 AI Harness 的核心命题:在模型能力给定的前提下,系统表现的方差主要由 Harness 决定。而八组各自的实践又给出了这一命题的行业化表述:

  • 软件工程组证明:Harness 差异足以造成数个百分点的表现差异,且全部改动可以不涉及换模型;剩余价值在度量侧。
  • 硬件研发组证明:当 ground truth 足够硬(形式化验证)而失败代价足够高(tape-out),Harness 的形态收敛为"编排引擎 + 人类在环 + 强沙箱"。
  • 知识协同组证明:检索质量的工程收益(失败率 5.7% → 1.9%)来自工程层而非模型层;权限必须下沉到检索层。
  • 数据科学组证明:当 ground truth 是物理定律时,评估层可以直接借用自然界;最大的风险是静默错误。
  • 创意产业组证明:一致性问题的本质是跨会话状态管理;合规义务已经下沉到元数据字段。
  • 风险合规组证明:L6 可以是主产品;判定权不能交给概率,慢是设计目标。

四个跨行业共性模式——确定性工具充当判定器、人在回路的分级设计、资产状态管理即 L4、证据链即 L6——是从八组实践中可迁移的结构性资产。任何组织建设自己的 Harness 时,都应先对照八组的层重点定位自身瓶颈,再按第 12 节的分期路径推进。


14. 信息缺口声明

本篇涉及以下信息缺口,均已按"不编造"原则处理,正文对应位置已标注 或说明口径,在此汇总:

  1. 第 5.2 节:Terminal-Bench 榜单中 Factory Droid 77.3%、OpenAI Simple Codex 75.1%、KRAFTON 74.7%、Bigai 71.9%、LangChain 52.8% → 66.5%、Vercel 80% → 100%,均为 B/C 级来源,[待核实]
  2. 第 6.2 节:验证团队规模相对 RTL 设计团队 2~5 倍(C 级);CVDP 基准 10%~40% 与 RealBench 无 AI 解出(C 级,[待核实]);Cerebrus / Questa One / ChipStack / GB200 等为厂商口径。
  3. 第 7.2 节:data.world 基准为自研基准(43 题、单一领域),未经大规模第三方复现,作为上限参考。
  4. 第 8.2 节:9% 数据工程师满意率、云端 API 调度 100 作业需 1~2 小时,为二手转述,[待核实]
  5. 第 9.2 节:可口可乐 70,000 片段精修为幕后报道(非官方披露);微短剧数据引自中国网络视听协会《微短剧创作指引》(经人民日报转载);AIGC 标识配套强制性国标为 GB 45438—2025(已确认,来源:国家标准全文公开系统)。
  6. 第 9.3 节 / 第 10 章:创意产业组效果数据大量为厂商自述口径,已按"据具体披露方披露"表述引用。
  • AI 动画无专门国家/行业标准;AI 短剧规范文号未公开——如实声明"暂无"。

  • 15. 参考资料

    1. Harness engineering: leveraging Codex in an agent-first world — OpenAI,2026-02-11。https://openai.com/index/harness-engineering/
    2. Harness design for long-running application development — Anthropic,2026。https://www.anthropic.com/engineering/harness-design-long-running-apps
    3. Effective harnesses for long-running agents — Anthropic,2025。https://www.anthropic.com/engineering/effective-harnesses-for-long-running-agents
    4. Introducing Contextual Retrieval — Anthropic,2024。https://www.anthropic.com/news/contextual-retrieval
    5. Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity — METR,2025-07-10。https://metr.org/blog/2025-07-10-early-2025-ai-experienced-os-dev-study/
    6. DORA 2025 State of AI-assisted Software Development — Google Cloud / DORA,2025-11-12。https://dora.dev/research/2025/dora-report/
    7. 2025 Stack Overflow Developer Survey — Stack Overflow,2025-07-30。https://survey.stackoverflow.co/2025/
    8. DARPA AI Cyber Challenge 决赛结果 — DARPA,2025。https://www.darpa.mil/news/2025/aixcc-results
    9. IBM Cost of a Data Breach Report 2025 — IBM / Ponemon Institute,2025-07-30。https://newsroom.ibm.com/2025-07-30-ibm-report-13-of-organizations-reported-breaches-of-ai-models-or-applications,-97-of-which-reported-lacking-proper-ai-access-controls
    10. Cadence Unveils Industry's First Fully Autonomous Virtual Engineer — Cadence,2026。https://www.cadence.com/
    11. Siemens Questa One Redefines IC Verification for Complex Chips — ENGtechnica,2025。https://engtechnica.com/siemens-questa-one-redefines-ic-verification-for-complex-chips
    12. Microsoft 365 Copilot Experiment: Cross-Government Findings Report — GOV.UK,2025。https://www.gov.uk/government/publications/microsoft-365-copilot-experiment-cross-government-findings-report/
    13. Lost in the Middle: How Language Models Use Long Contexts — Liu et al.,TACL 2024。https://arxiv.org/abs/2307.03172
    14. Generative AI Benchmark I — data.world。https://data.world/blog/generative-ai-benchmark-increasing-the-accuracy-of-llms-in-the-enterprise-with-a-knowledge-graph
    15. 人工智能生成合成内容标识办法 — 国家互联网信息办公室等四部门,2025。https://www.cac.gov.cn/2025-03/14/c_1743654684782215.htm
    16. Coca-Cola Refreshes Givers of the Season — The Coca-Cola Company,2025。https://coca-colacompany.com/
    17. 中注协提示会计师事务所在 2025 年年报审计中使用人工智能技术的风险防范 — 中国注册会计师协会,2026-03-05。https://cicpa.org.cn/
    18. GB/T 45654—2025《网络安全技术 生成式人工智能服务安全基本要求》 — SAC/TC260,2025。https://www.tc260.org.cn/
    19. Agentic MOF Screening on Aurora("LLM 从不接触调度器")— supercomputing.news。https://www.supercomputing.news/hpc/agentic-mof-screening-aurora
    20. AI 要给微短剧"洗牌"? — 人民日报,2026。https://kpzg.people.com.cn/n1/2026/0511/c404214-40717117.html

    Practice — Landing the Six-Layer Model in Eight Industry Groups


    1. Reading Guide and Positioning

    This chapter is one of the two with the heaviest technical weight in the white paper, and it connects with Chapter 3 (Architecture): Chapter 3 answers "what a third-generation Harness looks like", while this chapter answers "when it lands in eight industry groups, how the center of gravity shifts, which layer the bottleneck falls in, and what practices have already been validated".

    The eight industry groups are: AI Infra, Embodied Intelligence, Software Engineering, Hardware R&D, Knowledge Collaboration, Data Science, Creative Industries, and Risk & Compliance. All content is based on the research documents this project has already produced (each industry group's README and group-level AGENTS.md / SKILL.md); no new external retrieval is introduced. Every quoted hard data point matches its source document; where a source document is marked [To be verified], the same marking is used here.

    A criterion running through the whole chapter (this document's judgment): the same six-layer model has a completely different center-of-gravity distribution in different industries; any scheme that tries to cover all industries with a single generic agent template will fail exactly where rigor matters most. This is precisely the significance of the AI Harness as an "engineered carrying layer" rather than a "generic framework".


    2. Overview of the Eight Groups' Landing

    2.1. Layer-Emphasis and Bottleneck Matrix

    图 2-1|六层模型六大行业组落地:层重点与瓶颈分布

    六层模型六大行业组落地:层重点与瓶颈分布 示意:基于本章映射分析绘制 · 强调边框 = 瓶颈最集中的层(L6) L1 · 上下文与检索 重点:知识协同、数据科学 瓶颈:知识协同、风险合规、硬件(封装) L2 · 工具层 重点:硬件研发(最重) 瓶颈:硬件研发(验证)、风险合规(安全) L3 · 编排层 重点:知识协同(为主) 瓶颈:硬件研发(AI Infra) L4 · 记忆与状态 重点:创意产业(最重) 瓶颈:创意产业(一致性)、风险合规(审计) L5 · 评估层 重点:软件工程(最前沿)、硬件研发、数据科学 瓶颈:软件工程、数据科学(静默错误) L6 · 治理层(本图重点) 重点:风险合规(L6 输出即交付物) 瓶颈:知识协同、创意产业、硬件研发 结构解读:同一六层模型,各行业组重心完全不同:软件工程 L5、创意产业 L4、风险合规 L6。 焦点:瓶颈层决定各组第一优先级建设顺序(见 10.2 优先级建议)。

    数据来源:基于本文分析绘制的示意图。

    The table below is a mapping analysis based on each group's research documents; it is this document's own summary, not a rating by any standards organization.

    Industry GroupLayer EmphasisBottleneck LayerOne-Line Summary
    AI InfraL2 (physical foundation), spanning L1–L6L2 (physical ceiling) + L5 (measurement criteria)Chips and super-nodes set the physical ceiling of "what can be done"; with failures normalized and a PUE red line, fault-tolerant orchestration and energy consumption become front-loaded constraints at the same level as compute
    Embodied IntelligenceL2 + L3 (cerebrum/cerebellum separation real-time loop)L6 (physical safety) + L5 (sim2real domain gap)An agent runtime for the physical world: it shares the same Loop structure as the software domain, but the cost of each turn's error shifts from "rolling back a deployment" to "damaging equipment or injuring a person"
    Software EngineeringBalanced across layers, L5 evaluation at the frontierL5 (the measurement side has not yet crossed the trust threshold)The native domain of the Harness: executable code has a natural judge, but teams' judgment of AI effectiveness still stays at the level of subjective narrative
    Hardware R&DL2 + L5 heaviestL2 (tool heterogeneity, licensing limits); L6 highest cost (tape-out is irreversible)EDA tools are irreplaceable; formal verification is the only decidable ground truth
    Knowledge CollaborationMainly L1 + L3L1 (retrieval and context boundaries) + L6 (permission-aware retrieval)What the organization already knows — how to retrieve it reliably, use it, and govern it
    Data ScienceL1 + L5 heavy; the ground-truth form is the most specialL5 (silent errors make no sound)The ground truth of AI4S is physical law and experimental verification, not human annotation
    Creative IndustriesL4 heaviestL4 (cross-session consistency) + L6 (AIGC labeling compliance)The consistency problem is essentially a state-preservation problem across sessions, shots, and episodes
    Risk & ComplianceL6 heaviestL6 (auditable, traceable, human-in-the-loop)Here L6 is not a constraint but a product: AI output is examined by third parties as evidence

    2.2. Comparison of the Eight Groups' Ground-Truth Forms

    The form of the ground truth (the basis of judgment) is the first variable determining each group's Harness design differences (this document's judgment):

    Industry GroupGround-Truth FormJudgeDegree of Decidability
    AI InfraCluster SLO attainment and uninterrupted jobs (mechanically measurable)Monitoring metrics, checkpoint integrity checks, MLPerf and failure-profile baselinesHigh (metrics are truth), but efficiency conclusions strongly depend on baseline-criterion choice
    Embodied IntelligencePhysical law + real-machine acceptance (simulation side secondary)Bench tests (GB/T 43200-2023, GB/T 43199-2023), LIBERO / HumanoidBench benchmarks, real-machine acceptanceHigh on the simulation side, low in the open world; the gap is the sim2real domain gap
    Software EngineeringPass or fail of tests (programmatic scoring)Compilers, tests, CI gatesHigh, "no partial credit"
    Hardware R&DFormal verification and logic equivalence checking (LEC)Simulators, formal verification engines, ATE machinesHardest; mathematically exhaustive proof
    Knowledge CollaborationCitations traceable + review trailSource pointers, reviewer sign-offModerate; partly dependent on humans
    Data ScienceSQL result-set comparison, physical conservation laws, experimental reproductionSandboxed execution, physical-constraint checks, independent laboratoriesHigh (AI4S is physical law); deep research is the exception
    Creative IndustriesConsistency metrics + compliance-label verificationConsistency measurement, label read-back verificationModerate-to-low; subjective dimensions rely on Evaluator + human sign-off
    Risk & ComplianceRestoration of the evidence-chain five-tuplePoV reproduction, original-text back-reference, balance recomputation, human signatureHigh, but the judgment authority lies with humans and deterministic tools

    2.3. Comparison of the Eight Groups' Acceptance Anchors

    The eight groups' group-level AGENTS.md each establish their own acceptance anchors and sources of truth; their differences are themselves the projection of "layer-emphasis differences" onto the governance end (quoted from each group's group-level AGENTS.md):

    GroupAcceptance AnchorSource of TruthMain RisksHuman-in-the-Loop FocusL4 Memory Weight
    AI InfraCluster available, training uninterrupted, cost predictableMonitoring and logs (metrics are truth)Irreversible actions on production clusters, runaway capacity and budget, design-data sovereigntyChange-window approval + dual sign-off for destructive production-cluster operationsModerate (checkpoints and failure history)
    Embodied IntelligenceSimulation passes first + real-machine human-in-the-loop + safety certificationBench tests and real-machine acceptance (physical verification is truth)Equipment damage and personal safety, sim2real domain gap, teleoperation data complianceHuman-in-the-loop throughout real-machine operation; autonomous execution of irreversible physical actions is uniformly forbiddenHigh (real-machine trajectory data and body state)
    Software EngineeringCompilable, testable, deployable, rollback-ableCode and build results (executable is truth)Out-of-scope execution, destructive operations, supply chainPlan approval + result review + release confirmationLow (the codebase is the external memory)
    Hardware R&DFormal equivalence check passes + sign-off trailEDA tool output (tool verdict is truth)Design-data leakage, false convergence, irreversible actionsSign-off / tape-out / mass-production release with human dual sign-offModerate (regression history and coverage library)
    Knowledge CollaborationTraceable, reviewable, auditableCorpus and knowledge base (version marking required)Hallucination, out-of-scope retrieval, knowledge pollutionFact-checking + release approvalHigh (project memory is the core asset)
    Data ScienceReproducible (ACM four-level definition) + criteria traceableExecutable verification + physical lawSilent errors, criteria drift, out-of-scope visibilityCriteria adjudication + experiment pre-review + result re-reviewHigh (experiment records and failure library)
    Creative IndustriesAssets traceable + consistency达标 + labels compliantAsset-library versions + verification gatesCharacter drift, missed labels, copyright riskCreative-direction decisions + named-responsible-person sign-offHighest (consistency is cross-session state)
    Risk & ComplianceProvable, auditable, accountableRegulatory provisions and evidence chainsCompliance deviation, missing evidence, data leaving the domainConclusion re-check + trail + separation of dutiesModerate (case and precedent accumulation)

    Three points of reading (this document's judgment):

    1. Acceptance anchors are distributed along the spectrum of "executability → explainability → accountability": Software Engineering is at the far left of the spectrum (executable is trustworthy), Risk & Compliance at the far right (accountable is trustworthy), the other groups in between. This distribution is perfectly positively correlated with each group's L6 weight.
    2. The difference in authority tiers of sources of truth determines that each group's first priority for L1 context assembly differs: Software Engineering loads executable evidence first, Risk & Compliance loads currently-in-force norms first (with effective dates and authority tiers), Creative Industries loads asset-anchored context first (must not be trimmed).
    3. The L4 weight is proportional to "the reuse cycle of assets": the longer the asset reuse cycle (brand assets, project memory, experiment records), the higher the priority of building L4; the Software Engineering group, with the shortest reuse cycle, instead treats the codebase itself as external memory, with the lowest L4 weight.

    3. The AI Infra Group: The Physical Foundation of the L2 Execution Layer

    3.1. Layer Emphasis and Bottleneck

    The AI Infra group (AI chips / servers and super-nodes / cluster interconnect and data centers / training frameworks / inference frameworks / operations and observability) covers the physical foundation of the L2 execution layer in the Harness six-layer model: chips and super-nodes set the physical ceiling of what the agent "can do", training and inference frameworks are the scheduling hub of L2/L3, and operations and observability correspond to L5 and L6 (source document's claim). This group forms a "design → run" closed loop with the Hardware R&D group in Chapter 6 — the design side's packaging (CoWoS, HBM) determines the runtime side's VRAM ceiling, and the runtime side's failure profile in turn drives the design side's reliability goals.

    The group's structural tension is characterized by three sets of data (source document; tiers annotated):

    DimensionDataMeaning
    ScaleAs of the end of 2025, 42 ten-thousand-card intelligent-compute clusters have been built nationwide; the national intelligent-compute scale (FP16) was 1590 EFLOPS at the end of 2025 and 1882 EFLOPS at the end of March 2026 (per MIIT data, Tier B)Scale expansion turns hardware failures from exceptional events into routine events
    EnergyIn 2025, China's compute centers consumed 196 billion kWh (+18.1% year-on-year); 2030 is expected to exceed 500 billion kWh (CAICT criterion, Tier B); four departments require that by the end of 2025 newly built and expanded large/hyperscale data centers have PUE not exceeding 1.25, and national hub nodes not exceeding 1.2 (policy original text, Tier A)Energy is no longer a back-loaded data-center-specialty problem but a front-loaded constraint on chip selection and super-node form
    ReliabilityA 54-day snapshot of Meta Llama 3 405B training: of 466 job interruptions, 419 were unintentional (about one every 3 hours); GPU-related accounted for 58.7% of the unintentional interruptions (official technical report, Tier A)Fault-tolerant orchestration (rather than faster chips) becomes the first engineering problem

    Conclusion (this document's judgment): the entire engineering value of the AI Infra group lies in optimizing "fast compute", "affordable compute", and "stable compute" simultaneously — and none of the three lives inside the model layer; they can only be carried by the Harness's orchestration, observability, and governance layers.

    3.2. Key Practices and Cases

    Case 1: The "logical single-machine" of the super-node — the boundary of the L2 execution unit is redefined (Tier A, official criterion). Huawei's HC 2025 gave this group's most concise claim: "The super-node has become the dominant product form... the super-node is in fact a computer that can learn, think, and reason — physically composed of multiple machines, but logically one machine." This statement maps directly to the Harness's L2: when hundreds of accelerator cards present "single-machine" semantics through unified memory addressing, the model side's long-context carrying, KV sharing, and in-domain scheduling are all simplified into local operations — the boundary of the L2 execution layer is thereby moved up from "one card" to "one super-node".

    Case 2: CloudMatrix 384's system-level benchmarking (Tier A, paper measurement). Under the constraint of process limits, the domestic route chose "the system compensates for the single point": 384 Ascend 910C cards interconnected via the UB network form a rack-level unit with system-dense BF16 of about 300 PFLOPS; the engineering details of PDC (Prefill-Decode decoupling) and EP320 expert parallelism are public in the paper (arXiv 2506.12708). This group's unified requirement: domestic parameter citations must state whether they are paper measurements or launch-event criteria — the two have different evidence levels.

    Case 3: MegaScale's five-step fault-tolerance pipeline (Tier A, arXiv 2402.15627). The actual availability of ten-thousand-card training depends on "whether failures can be downgraded from global events to local events": heartbeat detection → self-check → isolation → replacement → checkpoint recovery. In echo, Llama 3 combines asynchronous checkpointing with hot-standby nodes, keeping effective training time at a high level. This pipeline is a direct embodiment of L3 orchestration and L4 state memory at the infrastructure layer — fault tolerance is not an operations action but an orchestration design.

    Case 4: Form-factor selection driven by the PUE red line (Tier A, policy original text). The hard metric of PUE ≤ 1.25 / 1.2 turns power distribution and cooling from a "data-center specialty" into a front-loaded constraint on chips and complete machines: all-optical inter-rack interconnect, mid-plane designs without cables, water pipes, or fans, and mandatory liquid cooling are all products of this constraint. The GB200 NVL72 liquid-cooling scheme reduces cost and energy by 25× (vendor criterion, Tier A).

    3.3. Landing Points

    1. Downgrade failures to local events: fault-tolerant orchestration (detection → isolation → replacement → checkpoint recovery) is a first-class engineering capability; the measurement criterion is the effective-training-time ratio (ETTR), not peak compute.
    2. Energy and compute have equal weight: energy budgets, PUE constraints, and change windows must be written into the group-level AGENTS.md red-line list, alongside the "forbidden list of irreversible actions".
    3. Criterion marking is trustworthiness infrastructure: any performance number must be marked "official release / MLPerf / third-party measurement / vendor claim" plus the hardware generation; vague "performance improvement" statements are uniformly forbidden within the group.
    4. Localization: the system compensates for the single point: under long-term process limits, the competitive focus shifts from single chips to system-level (super-node, interconnect, data format) innovation.
    5. The most common failure path: treating Infra as "data-center matters" unrelated to the agent — in fact it determines how long a context L1 can hold, how complex a toolchain L2 can run, and whether L5 can obtain a trustworthy efficiency baseline.

    4. The Embodied Intelligence Group: The Agent Runtime of the Physical World

    4.1. Layer Emphasis and Bottleneck

    The Embodied Intelligence group (cerebrum / cerebellum / servo motors and actuators / materials and sensors) is the group with the strongest explanatory power of the six-layer model and, at the same time, the highest cost of constraints (source document's claim). Its division has clear policy basis: MIIT's "Guiding Opinions on the Innovative Development of Humanoid Robots" (2023-11) divides the key technologies into three technology clusters — "cerebrum, cerebellum, limbs" — and the "Standard System for Humanoid Robots and Embodied Intelligence (2026 Edition)" further covers the entire industry chain with six major sections.

    The group's core claim is the "cerebrum/cerebellum separation architecture" — a direct mapping of the Harness Loop into the physical world:

    Embodied Intelligence DirectionMapped LayerCorrespondence
    CerebrumL1 + L3The VLM's perceptual assembly ≈ context assembly; task decomposition and skill scheduling ≈ Plan-and-Execute
    CerebellumL2 + L3 (real-time loop)Outputs action sequences at 50–200 Hz, equivalent to the Harness Loop's tool-execution loop, but with the latency budget compressed from seconds to milliseconds
    Servo motors and actuatorsL2 physical endMotor / reducer / ball screw is the physical carrier of "tool execution"; actuator selection ≈ tool contract (torque / precision / response)
    Materials and sensorsL1 + L5Sensors are the physical source of "deciding what the model sees" and also the hardware entry of the observation-feedback chain
    Teleoperation and real-machine dataL4Real-machine trajectory datasets ≈ long-term memory and artifact library; the data flywheel = experience accumulation
    Simulation and evaluationL5The simulation training field = regression set and Golden Dataset; sim2real transfer success rate = regression metric
    Safety normsL6Power and force limits (PFL) ≈ guardrails; functional safety tiers ≈ permissions and red lines

    Evidence anchors: Figure Helix (2025-02) slow system 7–9 Hz, fast system 200 Hz; NVIDIA Isaac GR00T N1 (2025-03-18) System 2 is VLM reasoning planning, System 1 is a Diffusion Transformer generating continuous actions; the reverse route also exists — Galbot's self-developed "Galbot Star Brain" claims "cerebrum-cerebellum-neural control integrated into one model" (company criterion). The two routes are presented in parallel; this document does not presuppose a single conclusion.

    Bottleneck identification (source document's claim): the cerebra and cerebella's bottleneck is at L5 (a structural gap exists between the 94%~97% on LIBERO and the real success rate in the open world; benchmarks such as HumanoidBench cover only the simulation side); the actuators' bottleneck is at L2 (once torque density, backlash, and response bandwidth are fixed, upper-layer algorithms cannot break through); the materials and sensors' bottleneck is at L1 (sensing data quality determines the physical ceiling of "what is seen"); the whole group's governance floor is at L6 — in the physical domain the cost of error is equipment damage and personal safety; ISO 10218:2025 (released 2025-02, in effect 2025-04-01, merged into the collaborative-safety requirements of ISO/TS 15066 including PFL) is this group's L6 anchor standard.

    4.2. Key Practices and Cases

    Case 1: Simulation first and the data pyramid (source document's engineering scheme). Real-machine data is extremely scarce (Mobile ALOHA body 75 kg, single-arm payload 750 g; teleoperation collection is extremely slow), so the industry adopts a "web video → synthetic data → real-machine teleoperation" data pyramid: GR00T N1's synthetic data brings a +40% performance gain and a 76.8% average real-machine success rate (Tier A); ALOHA-style low-cost master-slave arms + the ACT algorithm can collect about 50 data points in about 10 minutes, reaching an 80%~90% success rate; AgiBot World provides a million-scale shared dataset (1M+ trajectories, 217 tasks, 100 homogeneous robots). Simulation does not replace real machines; it amplifies the marginal value of real-machine data.

    Case 2: Explicit distinction of coincidental tier numbers (source document's claim; mandatory across the group). The group standard T/CIE 298-2025 "Grading of Humanoid Robot Intelligence" adopts "four dimensions, five levels" (four dimensions: perceptual cognition, decision learning, collaborative interaction, execution performance; from L1 basic execution level to L5 general intelligence level), which coincides numerically with the Harness six-layer model's L1–L6 but means something entirely different. Mixed use in group writing is forbidden; citations must write out the full standard number — this is the concrete landing of "terminology governance" at the L6 layer.

    Case 3: The actuator is a tool contract (source document's claim). Leaderdrive's triple-harmonic reducer precision is ≤10 arc-seconds, torsional stiffness improved 2–3× (Tier B); coreless motor efficiency is 70%–90%, the mainstream choice for dexterous-hand drive; the dexterous hand accounts for about 20%–30% of a humanoid robot's complete-machine cost. Once these hardware metrics are fixed, they directly bound the capability boundary of upper-layer strategies — the essence of actuator selection is writing a "tool contract".

    Case 4: Parallel presentation of conflicting criteria (source document's claim). Harmonic-reducer global share has three widely divergent criteria of 40% / 75% / 80%; 2025 global humanoid-robot shipments have multiple criteria such as 16,000 units and nearly 18,000 units (+508% year-on-year). This group's unified requirement: key share and scale data must all be marked with statistical criterion and source nature, presented in parallel across multiple criteria, without merging.

    4.3. Landing Points

    1. Physical-world safety red line: simulation first + human-in-the-loop throughout real-machine operation; autonomous execution of irreversible physical actions is forbidden. This is a hard constraint essentially different from the Software Engineering group's "sandbox + approval" — the cost of error is physical damage and personal safety.
    2. Safety norms are the L6 anchor: ISO 10218-1/2:2025 (including PFL power and force limits); actuator tests per GB/T 43200-2023; six-axis force calibration per GB/T 43199-2023; legged-robot performance tests per GB/T 44251-2024. Norm citations must write out the full standard number and edition.
    3. Dual reporting of benchmarks and real machines: reporting only simulation benchmark scores (LIBERO / HumanoidBench) is insufficient to prove capability; real-machine acceptance results must be reported simultaneously; the sim2real transfer success rate is the core regression metric.
    4. Asset-ization of data: real-machine trajectories, calibration records, and strategy checkpoints are long-term assets and must have unique identifiers, versions, and responsible persons; teleoperation data must be collected and used in compliance.
    5. Beware tier-terminology confusion: T/CIE 298-2025's L1–L5 and the Harness's L1–L6 must be explicitly distinguished; this is the most easily made, and most easily spread, statement error in this group.

    5. The Software Engineering Group: The Native Domain and the L5 Frontier

    5.1. Layer Emphasis and Bottleneck

    The Software Engineering group is the only conceptual native domain in the entire industry landscape of the AI Harness — the word Harness is borrowed directly from software engineering's Test Harness. The six layers develop in balance in this group, but L5 evaluation is at the frontier: code has compilers, tests, and CI, making this the only agent scenario at scale where "programmatic scoring" has landed.

    The group's structural tension is characterized by three data points (Tier-A sources):

    DataMeaning
    Claude Opus 4.6 scored 80.8% on SWE-bench Verified on 2026-02-05, the first model to break 80% on that leaderboard; Claude Sonnet 4.5 scored 51.0% on Terminal-Bench 2.0 on 2025-09-29, the first model to break 50% on that leaderboardThe capability side has crossed the usability threshold
    DORA 2025 (2025-11-12) shows 90%+ of developers already use AI at work; Stack Overflow 2025 shows 84% are using or plan to use itThe adoption side has crossed the diffusion threshold
    METR randomized controlled trial (2025-07-10): experienced open-source developers using AI were measured 19% slower but self-rated 20% faster; DORA 2025 shows developers' self-rated productivity +80%The measurement side has not yet crossed the trust threshold

    Conclusion (this document's judgment, following the source document): both capability and adoption are in place; the entire remaining value of the AI Harness in the software engineering field is almost concentrated in completing the measurement side.

    5.2. Key Practices and Cases

    Case 1: OpenAI's million-line code experiment (Tier A). First commit to an empty repository in late 2025-08; the scaffold was generated by Codex CLI + GPT-5; five months later about 1 million lines of code, about 1,500 PRs, 3 engineers (later expanded to 7), 3.5 PRs per person per day, time cost about 1/10 of hand-writing, 0 lines of human hand-written code, and the longest single task over 6 hours. The six key decisions (AGENTS.md about 100 lines as a table of contents, linter error messages written as repair instructions, doc-gardening agent, mechanical enforcement of the dependency chain, observability open to the agent, minimal-blocking merge) fall respectively on L1 / L6→L1 / L6 / L6 / L5→L1 / L3; the detailed breakdown is in Chapter 3, section 10.2.

    Case 2: Anthropic's two-generation long-running Harness solutions (Tier A). From the Initializer + Coding Agent dual-Agent division of labor (handoff package + three opening steps + clean-state wrap-up) to the Planner / Generator / Evaluator three roles (Sprint Contract + independent Evaluator + hard thresholds), it demonstrates the coordinated design of L3 / L4 / L5.

    Case 3: The measurement lesson of the METR controlled trial (Tier A). The divergence between measured 19% slower and self-rated 20% faster shows: self-rating measures the felt speed of "the code-writing segment", while measurement is end-to-end throughput; AI compressed the former while amplifying the cost of verification, review, and handling "almost-right-but-not-quite" products. In Stack Overflow 2025, 66% of respondents listed "AI solutions are almost right but not quite" as their biggest frustration — this is not a capability problem but a verifiability problem.

    Case 4: Quantification of scaffold differences (Tier B/C). The same model scores 2~14 percentage points apart across different Harnesses; LangChain changed only the Harness (same model, same API) and rose from 52.8% to 66.5%, with all five changes involving no model swap.

    5.3. Landing Points

    1. Dual-layer gates: product gates (compilable, testable, deployable, rollback-able) and process gates (trajectory evaluation, step caps, permission-hit checks) coexist; neither can be missing.
    2. Unify measurement to end-to-end: anchored on the four DORA metrics, forbid using lines of code or completion adoption rate as effectiveness conclusions; any efficiency conclusion must have a controlled measurement.
    3. Acceptance anchors: compilable, testable, deployable, rollback-able; process evidence (Trace, scorecards, human-confirmation records) is archived with the change.
    4. The most common failure path: skipping Eval and building Coding directly — without a regression set and trajectory evaluation, every prompt change is "by feel".

    6. The Hardware R&D Group: L2 and L5 Heaviest, L6 Cost Highest

    6.1. Layer Emphasis and Bottleneck

    The Hardware R&D group is the touchstone best able to test "whether the Harness truly converts the model's uncertainty into engineering predictability", because it simultaneously has two extreme features (source document's claim):

    1. The feedback closed loop is the most expensive: a single advanced-node tape-out is priced in hundreds of millions of dollars (IBS estimates 5nm~3nm at over $200M–$500M per chip, Tier B); design errors cannot be hot-fixed like software — this pushes L6 governance to the highest priority.
    2. The ground truth is the hardest: simulators, formal verification engines, ATE test machines, and metrology equipment can all give deterministic pass-or-fail verdicts — this means L5 does not need to be "built extra" but should directly reuse coverage databases, regression farms, and formal proofs.

    The core claim at the L2 level: EDA tools are irreplaceable; the agent's correct posture is not "replace the engine" but "orchestrate the engine." Cadence ChipStack orchestrates Xcelium (dynamic simulation) and Jasper (formal verification) inside an NVIDIA OpenShell sandbox; Siemens built its own MCP server exposing Questa One engine capabilities to agent frameworks, explicitly emphasizing "hooking into existing simulation engines rather than replacing them".

    The core claim at the L5 level: formal verification and logic equivalence checking (LEC) are the only decidable ground truth. Any netlist after AI optimization must undergo a formal equivalence check against the golden RTL, confirming functional behavior is unchanged, before it can enter subsequent flows.

    Per-direction bottleneck-layer distribution: 01 chip design at L5 (long design feedback cycles, proxy metrics decoupled from real performance); 02 chip verification at L2 (heterogeneous toolchains, licensed engines); 03 packaging at L1 (multi-physics, multi-vendor heterogeneous data hard to express uniformly); 04 testing at L6 (yield data is a core asset, forbidden from leaving the enterprise boundary); 05 AI Infra at L3 (at ten-thousand-card scale, failures become the norm).

    6.2. Key Practices and Cases

    CaseDataSource Tier
    Cadence CerebrusUp to 10× productivity + 20% PPAA (vendor criterion)
    Cadence ChipStackNVIDIA internal verification cycles sped up 40× or more; front-end design verification up to 10×A (vendor criterion)
    Siemens Questa OneCoverage accelerated 50×A (vendor criterion)
    AI-enabled EDA design cost savingsSemico Research forecasts 20%~30%; representative 14nm SoC measurement 21.3%B
    Industry AI design tool spending$300M in 2023, +20% per year, over $500M in 2026 (Deloitte TMT Predictions)B
    Verification's share of project cycles60%~70% (complex SoCs)B
    GB200 NVL72 liquid coolingReduces cost and energy by 25×A (vendor criterion)

    Benchmark gaps and anti-cheating (source document's claim three): GPT-4o's spec-to-RTL pass@1 on VerilogEval v2 is 63%; but per compilations of public talks, scores drop to 10%~40% on the CVDP benchmark, which is closer to production, and the hardest RealBench has still had no AI system solve any single problem (Tier C). This group therefore requires: reporting only academic benchmark scores is forbidden; real in-project regression metrics must be reported simultaneously. In addition, no public EDA Agent benchmark covering the full "tool invocation + multi-round debugging + coverage convergence" flow has been found — this is a real and important industry gap, meaning this domain cannot compare different Harness implementations horizontally the way software engineering relies on SWE-bench, and can only rely on enterprises' internal private regression sets.

    6.3. Landing Points

    1. Take the EDA engine as the sole referee: the model only produces candidate solutions; all candidate solutions must pass a formal equivalence check before entering sign-off; the model must not self-judge "it should be fine".
    2. Human-in-the-loop + strong sandbox + strong audit: irreversible actions such as tape-out, sign-off, and mass-production release require human confirmation + dual sign-off; agents have no direct trigger permission by default; autonomous agents must run in a sandboxed runtime (the NVIDIA OpenShell paradigm: policy control, isolation, controlled access to tools and design data).
    3. Design data does not leave the boundary: RTL, netlists, layouts, test programs, and yield data are the enterprise's core IP, encrypted and managed per IEEE 1735-2023.
    4. Coverage cannot be padded: distinguish code coverage from functional coverage and identify unreachable bins, otherwise "100% coverage but design flaws remain" false convergence occurs; SVA assertions generated by LLMs must be verified by formal tools.

    7. The Knowledge Collaboration Group: Mainly L1 and L3

    7.1. Layer Emphasis and Bottleneck

    The first batch of real scenarios for enterprises landing large models are, in the vast majority, not code-writing but: finding a document, answering a question, drafting a material, processing a ticket, running a process through. The capability bottleneck of these scenarios is not in the model itself but in the carrying layer between the model and the organization's existing knowledge assets and process assets (source document's claim).

    Seven directions (Projects / Works / Docs / RAG / Knowledge / Workflow / BPM) form a three-level progression of "information reachable → work orchestrable → processes governable", corresponding to the path of L1 moving up to L3, then to L6. There are two bottlenecks:

    • L1 (retrieval and context engineering): retrieval quality sets the ceiling of generation quality; structured knowledge is required, not optional, for complex queries; long context cannot replace context engineering.
    • L6 (permission-aware retrieval): permissions must land at the retrieval layer, not only at the application layer.

    7.2. Key Practices and Cases

    Case 1: The engineering payoff of Contextual Retrieval (Anthropic official, Tier A). Under the recall@20 criterion, the baseline retrieval failure rate is 5.7%; adopting Contextual Embeddings reduces it to 3.7%; adding Contextual BM25 reduces it to 2.9%; adding reranking reduces it to 1.9%, officially phrased as "reduce the number of failed retrievals by 49% and, when combined with reranking, by 67%". The one-time preprocessing cost is about $1.02 per million document tokens. This payoff comes from the engineering layer, not the model layer.

    Case 2: The order-of-magnitude lift of structured knowledge (data.world's own benchmark, Tier-A criterion but with stated limitations). On 43 business questions, the bare LLM's average execution accuracy is only 16.7%, with the two high-schema-complexity categories "metrics and KPIs" and "strategic planning" at 0%; connecting a knowledge graph triples accuracy; adding OBQC (Ontology-based Query Check) and LLM Repair reaches 72.55%, a 4.2× improvement over pure SQL. Note: this benchmark has 43 questions, 13 tables, a single insurance domain, GPT-4 zero-shot, and has not been reproduced at scale by third parties; it should be viewed as an upper-bound reference of the self-built method.

    Case 3: The physical limits of long context (academic paper, Tier A). Lost in the Middle (Liu et al., TACL 2024): multi-document QA shows a U-shaped curve; in some configurations, burying the relevant information in the middle performs even worse than closed-book — the retrieved context is a net negative. RULER (NVIDIA, COLM 2024): of 17 long-context models, only about half maintain satisfactory performance at 32K. NoLiMa (ICML 2025): of 13 models claiming ≥128K support, 11 fall below half their own short-context accuracy at 32K; GPT-4o drops from 99.3% to 69.7%.

    Case 4: The double-edged sword of permission inheritance (GOV.UK official report, Tier A). The UK government's cross-department M365 Copilot experiment: the tool "adopts the permissions of the end user and will only retrieve documents that a user could normally access", while officials simultaneously warn that "Copilot's ability to search and query using a user's access may highlight issues when users have access to files they shouldn't". Conclusion: permission inheritance is not "safe once configured" but amplifies existing permission-configuration errors.

    7.3. Landing Points

    1. Retrieval first, generation after: assertions without recall support are never output ("no source, no answer"); set a Recall@K evaluation gate on the retrieval chain; retrieval-strategy changes are scored before going live.
    2. Small-corpus exemption: when the knowledge base is under 200,000 tokens (about 500 pages), the full text can go directly into the prompt without RAG (Anthropic official original text); beyond that, the retrieval chain is mandatory.
    3. Permission-aware retrieval: do result filtering at the retrieval layer; make the confidentiality level an index field rather than an after-the-fact label; periodically run red-team tests with "unauthorized retrieval use cases".
    4. Standard absence is the norm; evaluation sets are the fill-in-the-gap means: of the seven directions, only Knowledge (ISO 30401:2018) and BPM (BPMN / CMMN / DMN / IEEE 1849 / OCEL 2.0) have formal standards; RAG, Docs, and Works have no corresponding ISO/IEEE formal standards, so an internal Golden Dataset and gate thresholds should be established.
    5. The most common failure path: skipping the first layer (information reachability) and going straight to building the third layer (process governance) — without trustworthy retrieval and knowledge governance, process automation only scales up errors.

    8. The Data Science Group: AI4S's ground truth is physical law

    8.1. Layer Emphasis and Bottleneck

    Data science group tasks have three structural characteristics (source document's claims): the product is not text but executable assertions (a SQL query, a simulation, a causal estimate all run on real systems and can be directly verified or falsified); errors are silent (a crashed pipeline immediately tells you it's broken, but a miscalculated pipeline tells you nothing); constraints come from the external world (permissions are determined by data classification, correctness is determined by physical law or business criteria, cost is determined by compute quota).

    The six-layer emphasis differs greatly across the six directions: 01 Data Engineering at L1 + L6; 02 Data Analysis at L1 + L5; 03 Deep Research at L1 + L3; 04 Scientific Computing at L2 + L4; 05 High-Performance Computing at L2 + L3; 06 Scientific Discovery (AI4S) at L5 + L3. The most essential difference is at L5: AI4S's ground truth is not human annotation but physical law, experimental verification, and conservation-law constraints.

    8.2. Key Practices and Cases

    Case 1: Argonne National Laboratory's Aurora agent material screening — "the LLM never touches the scheduler". In the agent material screening work on Aurora, MCP tools do not run simulations directly but instead emit Parsl applications, with Parsl responsible for placement, concurrency, and fault tolerance. This is the best empirical evidence of the L2/L3 separation and establishes this domain's default architecture: the agent should not directly invoke the scheduler but should produce job descriptions that can be carried by a workflow engine.

    Case 2: The cost of silent errors (source document's claims). A miscalculated pipeline does not report an error and appears with correctly formatted numbers and charts; a hallucinated review appears decoratively with complete citation formatting. The countermeasure is not a stronger model but: semantic regression sets + grain assertions + independent recomputation + result-set comparison, rather than relying only on row counts and freshness. Public reporting indicates (second-hand paraphrase) that only 9% of data engineers are satisfied with Airflow DAGs generated by general AI tools, the root cause being that the model lacks context such as the project DAG, execution environment, and existing conventions.

    Case 3: Evaluation cost and layered evaluation. A single scientific simulation can take 1,600~4,400 seconds, making high-frequency regression impossible; the countermeasure is layered evaluation: cheap proxy metrics first, expensive verification triggered on demand, proxy metrics periodically calibrated against ground truth. Another research report states that scheduling 100 jobs via a cloud API service takes 1~2 hours, limiting real-time deployment — the countermeasure is forced separation of inference and constraints: the model is responsible for inference, and deterministic modules are responsible for feasibility and safety.

    Case 4: The four-level reproducibility definition as the acceptance criterion. ACM gives a four-level terminology for reproducibility: Repeatability / Replicability / Reproducibility / Reusability; Harness's L4 should directly take these four levels as the acceptance criterion for memory-structure design — input data versions are traceable, execution environments are rebuildable, random seeds are controllable, and conclusions are recomputable.

    8.3. Landing Points

    1. Don't treat "looks right" as "right": make executable verification (SQL comparison, physical conservation-law checks, independent recomputation) a first-class citizen; pair analysis tasks with verified-queries regression sets, and look at Valid Efficiency Score (VES) in addition to Execution Accuracy (EX) — a query that returns correct rows via a full table scan is a production incident waiting to happen.
    2. Data classification is a hard boundary: RLS/CLS, PII masking, and cross-border restrictions are enforced at L6; the model should never be the judge of permissions.
    3. Reuse rather than reinvent orchestration: Airflow / dbt / Parsl / Slurm are data science's native orchestration forms; the value of the Harness lies in translating natural-language goals into job graphs these engines can digest.
    4. Fallback plan when ground truth is missing: the deep research direction has no standard answers, so adopt a hard DoD of citation verifiability rate, external benchmarks, and reviewer-agent grading + human supervision.

    9. The Creative Industries Group: L4 heaviest, consistency is cross-session state

    9.1. Layer Emphasis and Bottleneck

    The creative industries group's six directions (intelligent manufacturing / industrial internet / media / creative design / AI web dramas / AI animation) are divided into two categories by the difference in decidability of the deliverable (source document's claims):

    • Content side (media, creative design, AI web dramas, AI animation): the deliverable is a content asset, and a large part of the judgment criteria is "is it still the same person, the same brand, the same tone" — this is a class of cross-session, cross-shot, cross-episode state-preservation problem, so the L4 Memory and State layer is the quality bottleneck.
    • Industrial side (intelligent manufacturing, industrial internet): the deliverable is a state change in the physical world, and the judgment criteria are physical quantities such as yield, miss rate, and downtime, so L5 and L6 are the landing bottlenecks.

    The two sides share the same L6 baseline: the "Measures for Labeling AI-Generated Synthetic Content" (Guoxinban Tongzi [2025] No. 2) takes effect from 2025-09-01, requiring AI-generated synthetic content to carry explicit and implicit labels; Article 9 requires that related log records be retained for no less than six months; Article 10 explicitly forbids malicious deletion, tampering, forgery, or concealment of labels. Compliance obligations have already sunk to the level of metadata fields and export scripts — "writing metadata", "applying corner marks", and "keeping logs" are no longer operations actions but the Harness's L2 tool contract and L6 governance red line.

    9.2. Key Practices and Cases

    Case 1: Coca-Cola's holiday marketing — the engineering chasm between "clip quality" and "final-film quality". In the 2025 holiday marketing, 5 AI experts spent 30 days fine-tuning over 70,000 video clips (per behind-the-scenes reporting, not an official disclosure) before pulling the generative video model up to broadcast standard; the 2024 version was widely criticized for distorted human figures. This shows that there is a huge engineering chasm between the clip quality and the final-film quality output by generative models, and it is precisely the Harness that fills this chasm.

    Case 2: Scale crossing the critical point of human backstop. According to the China Netcasting Services Association's "Micro-Short-Drama Creation Guidelines" (cited from People's Daily, 2026), in Q1 2026 the whole industry launched about 128,000 micro-short-dramas, of which about 122,000 were AI micro-short-dramas, an share exceeding 95%. At this scale, any quality system relying on human item-by-item review will fail; consistency verification, label verification, and pre-review must be made into automatic gates on the pipeline.

    Case 3: Scripting deterministic operations. Anthropic's description of Agent Skills gives an engineering principle: having the model generate sorting results token by token is far more expensive than directly running a sorting algorithm, and many applications need "what only code can provide" — deterministic operations must be scripted, not generated by the model.

    9.3. Landing Points

    1. Consistency is a state-preservation problem: character, brand, and tone consistency must be treated as cross-session state, managed via L4 (asset library + version + consistency verification), not left to the model's in-context memory.
    2. Compliance obligations sink to tool contracts: label application, metadata writing, and log retention must be built into L2 tools and enforced at L6, not relying on human memory.
    3. Scale forces automation: at the 100,000-works scale, any quality system relying on human item-by-item review will fail; consistency verification, label verification, and pre-review must be made into automatic gates on the pipeline.
    4. Script deterministic operations: deterministic operations (sorting, formatting, batch processing) must be scripted, not generated by the model.

    10. The Risk & Compliance Group: L6 heaviest, the output is the deliverable

    10.1. Layer Emphasis and Bottleneck

    The Risk & Compliance group is the group where L6 is heaviest: here L6 is not a constraint but a product — AI output is examined by third parties as evidence (source document's claims). The group's core claim is: the deliverable of risk and compliance work is not a "conclusion" but a "provable conclusion" — every conclusion must be accompanied by a restorable evidence chain.

    The group's structural tension is characterized by three features (source document's claims):

    • The judge is external: the acceptability of the deliverable is not determined by the model but by auditors, regulators, and courts — this pushes L6 governance to the highest priority.
    • The evidence chain is the deliverable: every conclusion must be accompanied by a restorable evidence chain (data source, calculation process, model version, human sign-off) — this makes L4 memory and L5 observability a hard requirement rather than an option.
    • Errors are costly and irreversible: a compliance error may lead to regulatory penalties, litigation losses, or reputational damage — this pushes L6's human-in-the-loop to a mandatory rather than optional position.

    10.2. Key Practices and Cases

    Case 1: The evidence-chain five-tuple as the acceptance criterion (source document's claims). The group's unified acceptance criterion is the "evidence-chain five-tuple": data source traceable, calculation process reproducible, model version identifiable, human sign-off present, timestamp verifiable. Every deliverable must satisfy all five items; any missing item means the deliverable is not acceptable.

    Case 2: Human-in-the-loop as a mandatory gate (source document's claims). In risk and compliance scenarios, human sign-off is not an optional step but a mandatory gate: every conclusion that leaves the system must be signed off by a qualified human; the model's role is to provide supporting evidence and draft conclusions, not to make final judgments.

    Case 3: Audit logging as a first-class requirement (source document's claims). Audit logging is not an afterthought but a first-class requirement: every data access, every calculation, every model invocation, and every human decision must be logged with full context; the logs must be immutable and retained for the required period.

    10.3. Landing Points

    1. The evidence chain is the deliverable: every conclusion must be accompanied by a restorable evidence chain (data source, calculation process, model version, human sign-off, timestamp); any missing item means the deliverable is not acceptable.
    2. Human-in-the-loop is a mandatory gate: every conclusion that leaves the system must be signed off by a qualified human; the model provides supporting evidence and draft conclusions, not final judgments.
    3. Audit logging is a first-class requirement: every data access, calculation, model invocation, and human decision must be logged with full context; logs must be immutable and retained for the required period.
    4. Data does not leave the domain: sensitive data must not leave the controlled domain; model invocations must be within the authorized boundary.

    11. Extracting Common Patterns Across Industries

    11.1. The Universal Structure of the Six-Layer Model

    Across the eight industry groups, the six-layer model exhibits a universal structure (this document's judgment):

    1. L1 (Context Engineering) is the universal entry point: every group needs to decide "what the model sees"; the form of context assembly differs by group (executable evidence for software engineering, currently-in-force norms for risk and compliance, asset-anchored context for creative industries), but the need is universal.
    2. L2 (Tooling and Execution) is the universal interface: every group needs to decide "what the model can do"; the form of tool contracts differs by group (EDA engines for hardware, sandboxed executors for software, workflow engines for data science), but the need is universal.
    3. L3 (Orchestration and Control) is the universal coordinator: every group needs to decide "in what order to act"; the form of orchestration differs by group (plan-and-execute for software, real-time loops for embodied intelligence, deterministic workflows for data science), but the need is universal.
    4. L4 (Memory and State) is the universal accumulator: every group needs to decide "what to remember"; the form of memory differs by group (codebase for software, asset library for creative industries, experiment records for data science), but the need is universal.
    5. L5 (Evaluation and Observability) is the universal referee: every group needs to decide "how well it was done"; the form of evaluation differs by group (programmatic scoring for software, physical verification for embodied intelligence, evidence-chain restoration for risk and compliance), but the need is universal.
    6. L6 (Governance and Safety) is the universal guardrail: every group needs to decide "what must not be done"; the form of governance differs by group (sandbox + approval for software, physical safety for embodied intelligence, human-in-the-loop for risk and compliance), but the need is universal.

    11.2. The Differentiation Axis: Ground-Truth Form

    The primary axis of differentiation across the eight groups is the form of the ground truth (this document's judgment):

    Ground-Truth FormIndustry GroupsL5 EmphasisEvaluation Form
    Programmatic scoring (pass/fail of tests)Software Engineering, Hardware R&DHighestAutomated, reproducible, high-frequency
    Physical verification (laws, experiments)AI Infra, Embodied Intelligence, Data Science (AI4S)HighPhysical, expensive, low-frequency
    Consistency metrics + compliance labelsCreative IndustriesModerateSubjective + objective, medium-frequency
    Evidence-chain restorationRisk & ComplianceHighAudit-based, mandatory, low-frequency
    Citation traceability + review trailKnowledge CollaborationModerateHuman + automated, medium-frequency

    The form of the ground truth determines the form of L5 evaluation, which in turn determines the form of L6 governance. This is the primary axis of differentiation across the eight groups.

    11.3. The Differentiation Axis: Center-of-Gravity Distribution

    The secondary axis of differentiation is the center-of-gravity distribution across the six layers (this document's judgment):

    • L2-heaviest groups: AI Infra, Hardware R&D, Embodied Intelligence — the physical foundation and tooling are the primary constraints.
    • L4-heaviest groups: Creative Industries, Knowledge Collaboration — state preservation and memory accumulation are the primary constraints.
    • L5-heaviest groups: Software Engineering, Data Science — evaluation and observability are the primary constraints.
    • L6-heaviest groups: Risk & Compliance, Embodied Intelligence — governance and safety are the primary constraints.

    11.4. The Universal Failure Path

    Across the eight groups, the most common failure path is the same (this document's judgment): skipping the foundational layer and going straight to the advanced layer. For example, skipping L1 (context engineering) and going straight to L3 (orchestration), or skipping L5 (evaluation) and going straight to L6 (governance). The foundational layers must be built first; the advanced layers depend on them.


    12. Landing Path and Phased Recommendations

    12.1. The Three-Phase Landing Path

    Based on the eight groups' experiences, the landing path can be divided into three phases (this document's judgment):

    1. Phase 1: Build the foundation (L1 + L2): establish context engineering and tooling interfaces. This is the prerequisite for all subsequent phases.
    2. Phase 2: Build the loop (L3 + L4): establish orchestration and state management. This is the core of the Harness.
    3. Phase 3: Build the guardrails (L5 + L6): establish evaluation and governance. This is the guarantee of reliability.

    12.2. Phase-Specific Recommendations

    PhaseFocus LayersKey ActionsAcceptance Criteria
    Phase 1L1 + L2Establish context assembly and tool contractsContext assembly is reproducible; tool contracts are documented
    Phase 2L3 + L4Establish orchestration and state managementOrchestration is deterministic; state is recoverable
    Phase 3L5 + L6Establish evaluation and governanceEvaluation is automated; governance is enforced

    12.3. Common Pitfalls and Countermeasures

    1. Pitfall: skipping the foundation: going straight to advanced layers without building L1 + L2. Countermeasure: build the foundation first; the advanced layers depend on them.
    2. Pitfall: over-engineering: building all six layers at once without prioritizing. Countermeasure: follow the three-phase path; build incrementally.
    3. Pitfall: under-investing in L5: neglecting evaluation and observability. Countermeasure: L5 is not optional; it is the guarantee of reliability.
    4. Pitfall: ignoring L6: neglecting governance and safety. Countermeasure: L6 is not a constraint but a product; it must be built from the start.

    13. Conclusion

    The six-layer model exhibits a universal structure across the eight industry groups, but the center-of-gravity distribution differs by group. The primary axis of differentiation is the form of the ground truth, and the secondary axis is the center-of-gravity distribution across the six layers. The landing path should follow the three-phase structure: build the foundation (L1 + L2), build the loop (L3 + L4), and build the guardrails (L5 + L6). The most common failure path is skipping the foundational layer and going straight to the advanced layer.

    For the detailed landing practices of each industry group, see the corresponding chapters of this white paper. For the future evolution of the six-layer model, see Chapter 5 (Outlook).


    14. Information Gap Statement

    This document involves the following information gaps; they have been flagged in the corresponding places in the body and are summarized here:

    1. Section 3.1: the national intelligent-compute scale (FP16) data (1590 EFLOPS at end of 2025, 1882 EFLOPS at end of March 2026) is per MIIT data (Tier B).
    2. Section 3.1: the compute-center energy consumption data (196 billion kWh in 2025, +18.1% year-on-year; 2030 expected to exceed 500 billion kWh) is per CAICT criterion (Tier B).
    3. Section 3.2: CloudMatrix 384's system-dense BF16 performance (about 300 PFLOPS) is per paper measurement (Tier A, arXiv 2506.12708).
    4. Section 4.2: harmonic-reducer global share has three widely divergent criteria (40% / 75% / 80%); 2025 global humanoid-robot shipments have multiple criteria (16,000 units, nearly 18,000 units, +508% year-on-year).
    5. Section 5.2: the METR controlled trial data (measured 19% slower, self-rated 20% faster) is per the original paper (Tier A).
    6. Section 6.2: the AI-enabled EDA design cost savings (20%~30% forecast, 21.3% representative measurement) are per Semico Research (Tier B).
    7. Section 7.2: data.world's own benchmark (43 questions, 13 tables, single insurance domain, GPT-4 zero-shot) has not been reproduced at scale by third parties.
    8. Section 8.2: the 9% satisfaction rate for Airflow DAGs generated by general AI tools is per public reporting (second-hand paraphrase).
    9. Section 9.2: Coca-Cola's holiday marketing data (5 AI experts, 30 days, over 70,000 video clips) is per behind-the-scenes reporting, not an official disclosure.
    10. Section 10.2: the evidence-chain five-tuple as the acceptance criterion is this document's own summary, not a formal standard.

    15. References

    1. Effective context engineering for AI agents — Anthropic, 2025. https://www.anthropic.com/engineering/effective-context-engineering-for-ai-agents
    2. Effective harnesses for long-running agents — Anthropic, 2025. https://www.anthropic.com/engineering/effective-harnesses-for-long-running-agents
    3. Harness engineering: leveraging Codex in an agent-first world — OpenAI, 2026-02-11. https://openai.com/index/harness-engineering/
    4. METR: Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity — METR, 2025-07-10. https://metr.org/blog/2025-07-10-early-2025-ai-experienced-osdevs/
    5. DORA Report 2025: The State of AI-Assisted Software Development — Google DORA, 2025-11-12. https://dora.dev/research/
    6. 2025 Stack Overflow Developer Survey — Stack Overflow, 2025-07-29. https://survey.stackoverflow.co/2025/
    7. Lost in the Middle: How Language Models Use Long Contexts — Liu et al., TACL 2024. https://arxiv.org/abs/2307.03172
    8. RULER: What's the Real Context Size of Your Long-Context Language Models? — Hsieh et al., COLM 2024. https://arxiv.org/abs/2404.06654
    9. NoLiMa: A Simple Yet Complex-Benchmark for Long-Context LLMs — ICML 2025. https://arxiv.org/abs/2502.05167
    10. Microsoft 365 Copilot: Cross-Department Trial Report — GOV.UK, 2025. https://www.gov.uk/government/publications/microsoft-365-copilot-trial-report
    11. Agentic MOF Screening on Aurora ("the LLM never touches the scheduler") — supercomputing.news. https://www.supercomputing.news/hpc/agentic-mof-screening-aurora
    12. AI 要给微短剧"洗牌"? — 人民日报,2026。https://kpzg.people.com.cn/n1/2026/0511/c404214-40717117.html
    13. 中注协提示会计师事务所在 2025 年年报审计中使用人工智能技术的风险防范 — 中国注册会计师协会,2026-03-05。https://cicpa.org.cn/
    14. GB/T 45654—2025《网络安全技术 生成式人工智能服务安全基本要求》 — SAC/TC260,2025。https://www.tc260.org.cn/
    15. 《人工智能生成合成内容标识办法》(国信办通字〔2025〕2 号) — 国家互联网信息办公室,2025。https://www.cac.gov.cn/
    16. GB/T 43200-2023《机器人 工业机器人性能规范及其试验方法》 — SAC,2023。https://openstd.samr.gov.cn/
    17. GB/T 43199-2023《机器人 六维力/力矩传感器 性能规范及试验方法》 — SAC,2023。https://openstd.samr.gov.cn/
    18. ISO 10218-1/2:2025《Robotics — Safety requirements for industrial robots》 — ISO,2025。https://www.iso.org/standard/77447.html
    19. T/CIE 298-2025《人形机器人智能化分级》 — 中国电子学会,2025。https://www.cie.org.cn/
    20. 工信部《人形机器人创新发展指导意见》 — 工业和信息化部,2023-11。https://www.miit.gov.cn/