Search papers, labs, and topics across Lattice.
Touch2Insert is a novel tactile-based framework that enables zero-shot peg insertion by reconstructing cross-sectional geometry from high-resolution tactile images and estimating the relative pose of the hole with respect to the peg. It aligns reconstructed shapes through registration, enabling insertion from a single contact without task-specific training, addressing limitations of vision-based and learning-based approaches. Experiments with diverse connectors in simulation and real-robot settings demonstrate sub-millimeter pose estimation accuracy in simulation and an 86.7% average success rate on the real robot.
Forget finetuning: Touch2Insert achieves robust, zero-shot peg insertion by "feeling" the geometry with tactile sensors, bypassing the occlusion and generalization issues plaguing vision-based methods.
Reliable insertion of industrial connectors remains a central challenge in robotics, requiring sub-millimeter precision under uncertainty and often without full visual access. Vision-based approaches struggle with occlusion and limited generalization, while learning-based policies frequently fail to transfer to unseen geometries. To address these limitations, we leverage tactile sensing, which captures local surface geometry at the point of contact and thus provides reliable information even under occlusion and across novel connector shapes. Building on this capability, we present \emph{Touch2Insert}, a tactile-based framework for arbitrary peg insertion. Our method reconstructs cross-sectional geometry from high-resolution tactile images and estimates the relative pose of the hole with respect to the peg in a zero-shot manner. By aligning reconstructed shapes through registration, the framework enables insertion from a single contact without task-specific training. To evaluate its performance, we conducted experiments with three diverse connectors in both simulation and real-robot settings. The results indicate that Touch2Insert achieved sub-millimeter pose estimation accuracy for all connectors in simulation, and attained an average success rate of 86.7\% on the real robot, thereby confirming the robustness and generalizability of tactile sensing for real-world robotic connector insertion.
