Search papers, labs, and topics across Lattice.
The paper introduces a novel reinforcement learning framework for peg-in-hole (PiH) assembly by first training a policy for the easier, inverse task of peg-out-of-hole (PooH) disassembly. Trajectories from the PooH policy, incorporating visual and tactile information, are then reversed and action-randomized to serve as expert data for PiH policy learning. Results demonstrate that the visual-tactile PiH policy achieves higher success rates (87.5% on seen, 77.1% on unseen objects) and lower contact forces compared to direct RL methods and single-modality policies.
Training robots to assemble parts is easier if you first teach them how to take them apart.
Peg-in-hole (PiH) assembly is a fundamental yet challenging robotic manipulation task. While reinforcement learning (RL) has shown promise in tackling such tasks, it requires extensive exploration. In this paper, we propose a novel visual-tactile skill learning framework for the PiH task that leverages its inverse task, i.e., peg-out-of-hole (PooH) disassembly, to facilitate PiH learning. Compared to PiH, PooH is inherently easier as it only needs to overcome existing friction without precise alignment, making data collection more efficient. To this end, we formulate both PooH and PiH as Partially Observable Markov Decision Processes (POMDPs) in a unified environment with shared visual-tactile observation space. A visual-tactile PooH policy is first trained; its trajectories, containing kinematic, visual and tactile information, are temporally reversed and action-randomized to provide expert data for PiH. In the policy learning, visual sensing facilitates the peg-hole approach, while tactile measurements compensate for peg-hole misalignment. Experiments across diverse peg-hole geometries show that the visual-tactile policy attains 6.4% lower contact forces than its single-modality counterparts, and that our framework achieves average success rates of 87.5% on seen objects and 77.1% on unseen objects, outperforming direct RL methods that train PiH policies from scratch by 18.1% in success rate. Demos, code, and datasets are available at https://sites.google.com/view/pooh2pih.
