Search papers, labs, and topics across Lattice.
This paper introduces a unified framework for dexterous manipulation that integrates four canonical skills鈥攇rasping, relocation, in-hand rotation, and in-hand translation鈥攊nto a single formulation. By sharing the same state and action spaces, the framework allows for the distillation of a cross-skill policy that excels across all tasks, demonstrating robustness to disturbances and the ability to generalize to unseen objects. The findings reveal that treating these skills as variations of a common task structure enhances the continuity and compatibility necessary for complex, long-horizon manipulation tasks.
A unified framework reveals that dexterous manipulation skills are variations of a shared task, enabling seamless chaining and robust performance across diverse objects and hand morphologies.
Many dexterous manipulation tasks require the object to remain securely held throughout the interaction. From the perspective of hand-object relational motion, such manipulation comprises four canonical skills: grasping, relocation, in-hand rotation, and in-hand translation. Human hands flexibly compose these skills to accomplish complex tasks. Existing approaches, however, model these skills separately with skill-specific action constraints, objectives, or even dedicated hand morphologies, which breaks the compatibility and continuity required for long-horizon composition. In this work, we present a unified framework that models all four skills in a single formulation that shares the same state and action spaces and a common objective structure. This formulation enables straightforward distillation of a single cross-skill policy that performs strongly on every skill, generalizes to unseen objects, stays robust to disturbances, and chains skills seamlessly into long-horizon manipulation. The framework also transfers effectively across different hand morphologies. Overall, our results suggest that different dexterous manipulation skills can be viewed as instantiations of a shared task formulation, revealing the intrinsic consistency across different behaviors.
ETH