DataPlatter:利用低成本数据提升机器人操作泛化能力
DataPlatter: Boosting Robotic Manipulation Generalization with Minimal Costly Data
摘要 Abstract
视觉-语言-动作(VLA)模型在具身人工智能中的广泛应用加剧了对多样化操作演示数据的需求。然而,数据采集相关的高昂成本往往导致场景覆盖不足,限制了模型性能。研究发现,大型工作空间中的空间推理阶段(SRP)主导了失败案例的发生。幸运的是,这类数据可以低成本收集,凸显了利用廉价数据提升模型性能的潜力。本文提出DataPlatter方法,该框架将训练轨迹解耦为不同的任务阶段,并利用大量易于收集的SRP数据增强VLA模型的泛化能力。通过分析我们证明,针对特定子任务进行附加SRP数据的子任务特定训练,能够以适当比例作为机器人操作性能的催化剂,最大化利用昂贵的物理交互阶段(PIP)数据。实验表明,通过向有限的PIP数据集中引入大量成本效益高的SRP轨迹,我们在零样本场景中的成功率可提高41%,同时具备将操作技能迁移到新目标的能力。
The growing adoption of Vision-Language-Action (VLA) models in embodied AI intensifies the demand for diverse manipulation demonstrations. However, high costs associated with data collection often result in insufficient data coverage across all scenarios, which limits the performance of the models. It is observed that the spatial reasoning phase (SRP) in large workspace dominates the failure cases. Fortunately, this data can be collected with low cost, underscoring the potential of leveraging inexpensive data to improve model performance. In this paper, we introduce the DataPlatter method, a framework that decouples training trajectories into distinct task stages and leverages abundant easily collectible SRP data to enhance VLA model's generalization. Through analysis we demonstrate that sub-task-specific training with additional SRP data with proper proportion can act as a performance catalyst for robot manipulation, maximizing the utilization of costly physical interaction phase (PIP) data. Experiments show that through introducing large proportion of cost-effective SRP trajectories into a limited set of PIP data, we can achieve a maximum improvement of 41\% on success rate in zero-shot scenes, while with the ability to transfer manipulation skill to novel targets.