Search papers, labs, and topics across Lattice.
This paper introduces WARP, a novel offline pipeline for whole-body mobile manipulation that addresses the embodiment gap in transferring human demonstrations to robot actions. By employing a closed-form Shoulder-Elbow-Wrist (SEW) geometric solver, WARP ensures precise end-effector tracking while maintaining the structural intent of whole-body actions, resulting in consistent and reliable robot trajectories. Evaluations demonstrate that WARP achieves zero-shot whole-body mobile manipulation directly from offline human demonstrations, marking a significant advancement in scalable robotic learning without the need for teleoperation data.
WARP achieves zero-shot whole-body mobile manipulation from offline human demonstrations, eliminating the reliance on teleoperation data.
Direct transfer from human demonstration to learnable robot action is a crucial step towards scalable whole-body mobile manipulation. While human data scales better than mobile teleoperation, it requires overcoming significant embodiment gaps. Existing retargeting methods yield imprecise or inconsistent solutions, causing action multi-modality that prevents supervised policies from reliably converging. We present Whole-body-Aware Retargeting from human Pose (WARP), an offline pipeline that explicitly models embodiment differences to extract precise, unique whole-body actions. WARP leverages a closed-form Shoulder-Elbow-Wrist (SEW) geometric solver for exact end-effector tracking while preserving whole-body structural intent. Paired with lazy mobile-base control, it extracts accurate, consistent robot trajectories. Evaluations show WARP provides highly reliable data for open-loop real-world replay. To our knowledge, WARP is the first framework to achieve zero-shot whole-body mobile manipulation directly from offline human demonstrations, eliminating the need for human-in-the-loop teleoperation action data. More details on https://warp-retarget.github.io/
