Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
X-Reset bypasses the exploration bottleneck in dexterous manipulation by converting human hand-object demonstrations into physically valid simulation reset distributions rather than tracking or imitating them as trajectory targets. This decouples policy learning from embodiment-specific kinematics, allowing generalist policies to train from scratch using purely task-agnostic, object-centric rewards. Across three distinct embodiments—including a 22-DoF hand and a parallel-jaw gripper—the framework successfully scales across 20 manipulation tasks, generalizes to unseen objects, and transfers zero-shot from simulation to reality.
Human hand demonstrations don't need to be tracked or imitated to solve dexterous manipulation—they just need to seed the simulation's reset distribution.
Reinforcement learning (RL) in simulation can train dexterous manipulation policies without robot demonstrations, but training a single generalist policy with task-agnostic rewards faces a severe exploration problem: approaching, grasping, and reorienting diverse objects with many degrees of freedom is difficult to discover from scratch. Prior works make exploration tractable with high-quality robot demonstrations, per-task reward shaping, or by restricting policies to narrow modes of behavior. We propose X-Reset, a framework that instead resolves exploration with human hand-object demonstrations. Rather than imitating or tracking retargeted human motion, X-Reset kinematically retargets hand-object states to noisy robot states, filters out states that are unstable in simulation, and samples the remainder as resets during RL training with general-purpose object-centric rewards. The resulting policy depends only on object state and goal, with demonstrations entering training through the reset distribution. We show that X-Reset trains generalist policies on 20 objects across three embodiments---a 22-DoF hand on two different arms and a parallel-jaw gripper---and resolves the exploration challenges of RL from scratch. X-Reset scales with the number of training objects, generalizes to unseen objects, can learn from imperfect hand-pose estimates, and transfers behaviors zero-shot from sim-to-real.