Search papers, labs, and topics across Lattice.
This paper introduces AetheRock, an innovative arm-worn device designed for the efficient collection of gripper-force, vision, and tactile data, addressing the integration challenges of tactile and force sensors in wearable robotics. The authors propose ForceVT, a representation learning framework that leverages force and vision to enhance tactile learning, demonstrating its effectiveness in real-world scenarios despite sensor inconsistencies. Experimental results indicate that AetheRock achieves significant data efficiency while ForceVT improves the robustness of tactile inference across various conditions.
AetheRock not only streamlines data collection for robot learning but also pairs it with a novel framework that enhances tactile learning in the face of sensor inconsistencies.
Force and tactile sensing are indispensable in contact-rich manipulation. However, force-aware robot learning faces critical challenges due to the incompatible assembly of tactile and force sensors in handheld or wearable devices. To address these limitations, we first introduce AetheRock for gripper-force, vision, and tactile data collection, which is an arm-worn device featuring a modular and easily manufactured visuo-tactile sensor, GelSlim-MiniFab, at the fingertip, a resistive pressure sensor at the human finger contact region, a customized PCB module, and a wearable kit for comfortable and robust collection. Building on this, we propose ForceVT, a representation learning framework that uses force and vision to guide fidelity-agnostic tactile learning, enabling robust inference in any tactile situation. Real-world experiments show that AetheRock achieves qualified data efficiency and that ForceVT effectively alleviates inefficiencies when visuo-tactile sensors exhibit manufacturing and utilization inconsistencies. Overall, our work mitigates the limitations of gripper-force vision-tactile robot learning through innovative hardware design and algorithms.
