Search papers, labs, and topics across Lattice.
This paper introduces ReForce, a novel method for force-aware retargeting that enhances the transfer of human manipulation demonstrations to robotic actions by addressing the embodiment gap. By predicting a residual on kinematically retargeted actions to achieve desired forces, ReForce leverages a general force tracker trained on extensive simulation data. The method demonstrates significant improvements in force-tracking accuracy and multi-finger contact engagement during complex manipulation tasks, both in simulation and on physical robots.
Robots can now mimic human dexterity more effectively by learning to apply the right forces during manipulation, bridging the gap between human demonstrations and robotic actions.
Human demonstrations offer a scalable data source for dexterous manipulation, but transferring them to robot actions remains challenging due to the embodiment gap. Today's retargeting is mostly kinematic, yet manipulation is decided by force, which governs how the hand interacts with the object and how the object moves. In this paper, we present ReForce, a Force-aware Retargeting method that turns human motion and forces into robot actions that reproduce the intended contact. ReForce predicts a residual on the kinematically retargeted action to reach the desired force, using a general force tracker trained on large-scale simulation interactions. It supports both online force-aware teleoperation and offline data translation. In simulation and on real hardware, ReForce achieves lower force-tracking error and stronger multi-finger contact engagement on contact-rich tasks such as paper-cup grasping and tongs manipulation.
