Search papers, labs, and topics across Lattice.
This paper introduces SynManDex, a synthetic pipeline that synthesizes human-like dexterous grasps by leveraging generated human pre-grasps and optimizing them for robotic hands. The method addresses the challenges of morphology, contact, and reachability constraints, achieving a high grasp stability of 86.4% and a human-likeness rating of 4.67/5. Ultimately, SynManDex demonstrates a robust performance with 80.7% success in simulation and 83.3% in real-robot applications, showcasing its potential for complex manipulation tasks.
Achieving 86.4% grasp stability and 83.3% real-world success, SynManDex bridges the gap between human dexterity and robotic manipulation.
Human hand-object interactions encode functional intent, but direct transfer to robotic hands often fails under morphology, contact, and reachability constraints. We present SynManDex, a synthetic pipeline that uses generated human pre-grasps as affordance-aware proposals and resolves the final contacts with robot-native optimization. SynManDex samples object-conditioned digital human pre-grasps, retargets them to dexterous robotic hand poses, optimizes force-closure contacts on the target embodiment, and admits trajectories that pass checks from each step. The resulting keyframes support both grasp-and-lift demonstrations and various prehensile manipulation tasks such as tea pouring, photo taking, and flute playing, designed via VLM agents. As a result, SynManDex combines high grasp quality (86.4\% grasp stability) with 4.67/5 human-likeness (93.4\%). It achieves 80.7\% successes in simulation and 25/30 (83.3\%) real-robot successes when applied to a 36-DOF bimanual dexterous robotic platform.
