---
title: "从高保真UMI数据学习可部署操作策略"
source: "arXiv AI/CL/LG（论文）"
source_tier: "t2"
url: "https://arxiv.org/abs/2607.25895v1"
permalink: "https://feed.astralor.com/items/itm_4d813e350039d2ae6ba505c3"
published: "2026-07-28T15:52:02.000Z"
score: 83
channel: "ai"
tags: ["HiFi-UMI","SLAM","UMI","机器人操作","策略学习"]
---

# 从高保真UMI数据学习可部署操作策略

## AI 点评

> 这篇论文最亮眼的地方是证明了纯无机器人数据也能达到与真实遥操作相当的性能，彻底打破了后训练阶段必须依赖少量真实数据的惯例。对于想降低硬件成本的研究组和工业机器人应用开发者来说，HiFi-UMI的数据生产方案和开源数据集是直接可用的资源。建议关注其头戴式SLAM和微秒同步的工程细节，这些是精度达标的关键。

## 速览

机器人操作策略的部署受限于数据的高保真与可扩展性。真实遥操作准确但成本高，无机器人UMI捕获易于扩展但精度不足。本文提出HiFi-UMI，一种便携式数据生产系统，通过头戴式离线立体惯性SLAM、原生相对位姿、微秒级GPIO触发和每手200度广角相机，在无外部追踪下达到3mm末端精度。利用该数据，策略仅用HiFi-UMI演示进行后训练即可直接部署，在三个骨干网络上与遥操作基线表现相当（成功率差异-2.5至+3.1个百分点），最强策略在精密插入任务达85%。4000小时预训练使十项未见任务动作误差降低41%。开源HiFi-UMI-2K数据集，含2000小时微秒同步超广角演示。

## 关键点

- HiFi-UMI系统通过头戴式SLAM、原生相对位姿、微秒触发和广角相机达到3mm末端精度，无需外部追踪。
- 仅用HiFi-UMI演示数据后训练的策略可直接部署于真实机器人，在三个骨干网络上与遥操作基线表现接近。
- 4000小时同一数据集预训练使十项未见任务动作误差降低41%，并在StarVLA-QwenPI上提升成功率18.1个百分点。
- 开源HiFi-UMI-2K数据集包含2000小时微秒同步超广角演示，经仿真回放自动重建和验证。

## 全文

Learning deployable manipulation policies is bottlenecked by the scarcity of data that is both high-fidelity and scalable. Real-robot teleoperation is accurate but costly to scale; robot-free UMI capture scales readily, and current practice uses the resulting data mainly for pre-training, adding a small real-robot "anchor" at post-training. We ask whether raising the fidelity of robot-free UMI data, rather than shrinking the real-robot fraction, can remove that anchor. We present HiFi-UMI, a portable UMI data-production system co-designed for trajectory accuracy, inter-gripper relative pose, synchronization, and field of view: head-mounted offline stereo-inertial SLAM, native rather than reconstructed relative pose, a shared microsecond GPIO trigger, and two wide-angle cameras per hand covering ~200 degrees. It reaches 3 mm workspace-local end-effector accuracy without external tracking infrastructure. Using this corpus, we demonstrate zero-robot post-training: a policy post-trained solely on HiFi-UMI demonstrations deploys directly on a real robot and matches in-domain teleoperation across three backbones spanning the vision-language-action and world-action-model families, with success-rate differences of -2.5, +3.1, and -0.6 percentage points on StarVLA-QwenPI, OpenPI-pi_0.5, and LingBot-VA; the strongest policy reaches 85% on a precision insertion task, even though the teleoperation baseline is collected in the evaluation scene and no HiFi-UMI trajectory is. Pre-training on 4,000 hours from the same corpus lowers action error on ten unseen tasks by 41% and, on StarVLA-QwenPI, raises real-robot success by a further 18.1 percentage points. We open-source HiFi-UMI-2K, 2,000 hours of microsecond-synchronized, ultra-wide-FoV demonstrations, each automatically reconstructed and validated through simulation replay, as a large-scale, high-fidelity resource for the robot-learning community.

---

引用前请核对原文;本文由星际流动整理:https://feed.astralor.com/items/itm_4d813e350039d2ae6ba505c3