具有腿式操纵器的全身动态投掷

Whole-Body Dynamic Throwing with Legged Manipulators

摘要 Abstract

使用带有腿式结构的机器人进行投掷需要精确协调物体操作与运动能力——这是实现高级现实世界交互的关键。大多数研究集中于单独关注操作或运动,对同时需要两者任务的探索较少。本文研究了在腿式操纵器中利用全身所有电机(而非仅限手臂)进行投掷的优势。我们将该任务定义为深度强化学习(RL)目标,优化投掷精度以达到用户指定的目标位置,并保持机器人的稳定性。仿真评估显示,全身体投掷通过利用身体动量、反向平衡以及全身动力学,提高了投掷距离、准确性和稳定性。我们引入了一种优化自适应课程策略,以平衡投掷准确性和稳定性,同时设计了一个定制化的RL环境设置,以在稀疏奖励条件下实现高效学习。与以往工作不同的是,我们的方法能够推广到三维空间中的目标。我们将训练出的控制器从仿真转移到真实的人形平台。

Throwing with a legged robot involves precise coordination of object manipulation and locomotion - crucial for advanced real-world interactions. Most research focuses on either manipulation or locomotion, with minimal exploration of tasks requiring both. This work investigates leveraging all available motors (full-body) over arm-only throwing in legged manipulators. We frame the task as a deep reinforcement learning (RL) objective, optimising throwing accuracy towards any user-commanded target destination and the robot's stability. Evaluations on a humanoid and an armed quadruped in simulation show that full-body throwing improves range, accuracy, and stability by exploiting body momentum, counter-balancing, and full-body dynamics. We introduce an optimised adaptive curriculum to balance throwing accuracy and stability, along with a tailored RL environment setup for efficient learning in sparse-reward conditions. Unlike prior work, our approach generalises to targets in 3D space. We transfer our learned controllers from simulation to a real humanoid platform.

具有腿式操纵器的全身动态投掷 - arXiv