Search papers, labs, and topics across Lattice.
The paper introduces TAMEn, a tactile-aware manipulation engine featuring a wearable interface adaptable to various grippers, designed for collecting high-quality robot manipulation data. They implement a dual-modal acquisition pipeline, combining motion capture for precision and VR-based tracking for portability and tactile-visualized recovery. By integrating large-scale tactile pretraining, bimanual demonstrations, and human-in-the-loop recovery data within a pyramid-structured data regime, TAMEn significantly improves demonstration replayability and boosts task success rates in bimanual manipulation tasks from 34% to 75%.
Tactile-aware robot manipulation gets a serious upgrade: TAMEn's wearable interface and data pipeline more than double task success rates in complex bimanual tasks.
Handheld paradigms offer an efficient and intuitive way for collecting large-scale demonstration of robot manipulation. However, achieving contact-rich bimanual manipulation through these methods remains a pivotal challenge, which is substantially hindered by hardware adaptability and data efficacy. Prior hardware designs remain gripper-specific and often face a trade-off between tracking precision and portability. Furthermore, the lack of online feasibility checking during demonstration leads to poor replayability. More importantly, existing handheld setups struggle to collect interactive recovery data during robot execution, lacking the authentic tactile information necessary for robust policy refinement. To bridge these gaps, we present TAMEn, a tactile-aware manipulation engine for closed-loop data collection in contact-rich tasks. Our system features a cross-morphology wearable interface that enables rapid adaptation across heterogeneous grippers. To balance data quality and environmental diversity, we implement a dual-modal acquisition pipeline: a precision mode leveraging motion capture for high-fidelity demonstrations, and a portable mode utilizing VR-based tracking for in-the-wild acquisition and tactile-visualized recovery teleoperation. Building on this hardware, we unify large-scale tactile pretraining, task-specific bimanual demonstrations, and human-in-the-loop recovery data into a pyramid-structured data regime, enabling closed-loop policy refinement. Experiments show that our feasibility-aware pipeline significantly improves demonstration replayability, and that the proposed visuo-tactile learning framework increases task success rates from 34% to 75% across diverse bimanual manipulation tasks. We further open-source the hardware and dataset to facilitate reproducibility and support research in visuo-tactile manipulation.
