Track new results across pure and applied mathematics.
Search papers, labs, and topics across Lattice.
The authors develop HOI-Retarget, a framework that transfers complex human-object interactions onto humanoid robots by anchoring motion retargeting around contact targets in the object frame. Solving the severe data bottleneck in whole-body humanoid manipulation requires retargeting strategies that preserve physical contact fidelity despite morphology mismatches. The resulting windowed trajectory optimization synthesizes kinematically feasible motions from monocular video, parameterizes single demonstrations across varying object geometries, and scales to multi-humanoid collaborative manipulation.
Scaling humanoid manipulation data no longer requires dedicated teleoperation setups: anchoring retargeting directly in the object's contact frame unlocks automated, kinematically consistent demonstration synthesis from monocular video and across varied object geometries.
Learning from demonstration (LfD) has enabled humanoid robots to acquire diverse whole-body skills, but extending this paradigm to human-object interaction (HOI) is limited by the availability of robot-compatible interaction references. We present HOI-Retarget, a contact-centric retargeting method that transfers HOI onto a humanoid robot for large-scale motion-data generation. Its windowed trajectory optimization uses every labeled contact as a target in the object frame, balancing body tracking, foot support and smoothness under the robot's kinematic limits. The method can augment a single demonstration across object sizes, absorb contacts reconstructed from monocular video, and extend to several robots manipulating one object. We publicly release the code and the retargeted motion dataset.
ETH