Search papers, labs, and topics across Lattice.
The VTOUCH dataset addresses the challenges of bimanual manipulation in contact-rich tasks by providing a comprehensive collection of vision-based tactile signals and a systematic task organization. This dataset is designed to facilitate scalable and effective learning through automated data collection from real-world scenarios. Extensive experiments validate its utility, showing that it enables generalizable inference across various robots and manipulation tasks.
Vision-based tactile signals in the VTOUCH dataset significantly enhance bimanual manipulation capabilities, paving the way for more effective robotic interactions.
Embodied intelligence has advanced rapidly in recent years; however, bimanual manipulation-especially in contact-rich tasks remains challenging. This is largely due to the lack of datasets with rich physical interaction signals, systematic task organization, and sufficient scale. To address these limitations, we introduce the VTOUCH dataset. It leverages vision based tactile sensing to provide high-fidelity physical interaction signals, adopts a matrix-style task design to enable systematic learning, and employs automated data collection pipelines covering real-world, demand-driven scenarios to ensure scalability. To further validate the effectiveness of the dataset, we conduct extensive quantitative experiments on cross-modal retrieval as well as real-robot evaluation. Finally, we demonstrate real-world performance through generalizable inference across multiple robots, policies, and tasks.
