本文介绍了一个多物体抓取基准，用于评估机器人系统在堆叠场景和表面场景中的抓取和操作能力。该基准提出了三种机器人多物体抓取基准协议，旨在挑战机器人操作的不同方面。这些协议包括：1) “Only-Pick-Once” 协议，用于评估机器人一次性高效抓取多个物体的能力；2) “Accurate pick-transferring” 协议，用于评估机器人从杂乱环境中选择性抓取并转移特定数量物体的能力；3) “Pick-transferring-all” 协议，用于挑战机器人通过依次抓取并转移所有可用物体来清理整个场景的能力。这些协议旨在被更广泛的机器人研究社区采用，提供一种标准化方法来评估和比较机器人系统在多物体抓取任务中的性能。我们使用标准规划和感知算法在Barrett手部、Robotiq平行夹爪以及Pisa/IIT Softhand-2（一种软体欠驱动机械手）上建立了这些协议的基线。我们还讨论了这些结果与人类在类似任务中的表现的关系。

In this work, we describe a multi-object grasping benchmark to evaluate the grasping and manipulation capabilities of robotic systems in both pile and surface scenarios. The benchmark introduces three robot multi-object grasping benchmarking protocols designed to challenge different aspects of robotic manipulation. These protocols are: 1) the Only-Pick-Once protocol, which assesses the robot's ability to efficiently pick multiple objects in a single attempt; 2) the Accurate pick-trnsferring protocol, which evaluates the robot's capacity to selectively grasp and transport a specific number of objects from a cluttered environment; and 3) the Pick-transferring-all protocol, which challenges the robot to clear an entire scene by sequentially grasping and transferring all available objects. These protocols are intended to be adopted by the broader robotics research community, providing a standardized method to assess and compare robotic systems' performance in multi-object grasping tasks. We establish baselines for these protocols using standard planning and perception algorithms on a Barrett hand, Robotiq parallel jar gripper, and the Pisa/IIT Softhand-2, which is a soft underactuated robotic hand. We discuss the results in relation to human performance in similar tasks we well.