Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Whole-Body Dexterity (WBD), a framework enabling humanoid robots to leverage their entire bodies, not just end-effectors, for dexterous manipulation of bulky objects. A sim-to-real pipeline generates whole-body grasp data, trains RL experts on repositioning, and distills them into a single policy that utilizes proprioception and object geometry. The distilled policy achieves 90% success on real-world whole-body manipulation tasks, significantly outperforming baselines.
Humanoid robots can now grasp and manipulate bulky objects using their entire bodies, achieving 90% success in complex repositioning tasks.
Current humanoid dexterous manipulation remains largely confined to end-effectors and simple grasps, falling short of humans'ability to engage the entire body by bracing and sliding bulky objects against the arms and torso. We introduce Whole-Body Dexterity (WBD), a general framework that uses the robot's body and appendages as contact surfaces to grasp and manipulate objects. Our sim-to-real pipeline first generates a dataset of feasible whole-body grasps, then trains reinforcement-learning experts on a general any-to-any repositioning objective by sampling initial and goal grasps from the dataset, and distills these experts into a single policy that uses proprioception and object geometry. We show that the distilled policy transfers zero-shot to a real Unitree G1, where it repositions a basketball and a cardboard box to regions around the torso and completes a long-horizon task that stows a box under one arm, carries it from a shelf to a table, and places it. The controller operates interactively, steered by coarse motion references from a human teleoperator. Across real-world whole-body manipulation tasks, the distilled controller completes 90% of trials, compared with 18% for direct retargeting and 4% for a generalist whole-body controller.