Search papers, labs, and topics across Lattice.
This paper introduces TACTFUL, a tactile exploration framework that allows a multi-fingered robot to autonomously locate and identify objects in confined environments without relying on visual input. By leveraging a single policy that balances global exploration and local surface refinement, TACTFUL achieves a remarkable 77% success rate and an average reconstruction error of just 0.015 m, outperforming existing methods. The findings highlight the effectiveness of tactile sensing combined with structured learning for object-level reasoning in real-world scenarios.
TACTFUL achieves 77% success in object localization using only tactile feedback, showcasing a paradigm shift in robotic perception.
Humans effortlessly locate and identify objects by touch alone, even without vision. In contrast, robotic systems rely heavily on vision and struggle with autonomous tactile exploration and object identification. We present TACTFUL, a vision-free tactile exploration framework that enables a multi-fingered robot to autonomously explore confined workspaces, discover objects through contact, and identify them via tactile reconstruction. Trained entirely on real hardware without simulation, our system learns a single policy that balances global workspace exploration with local surface refinement through a dynamic reward schedule. Our results demonstrate that tactile sensing, when paired with structured learning, can serve as an effective primary modality for object-level reasoning, achieving 77% success with 0.015 m average reconstruction error and outperforming baseline approaches on real-world objects.
