Search papers, labs, and topics across Lattice.
This paper introduces DexTeleop-0, a bimanual dexterous teleoperation system that enhances fine-grained manipulation by integrating tactile feedback and an ego-centric perception approach. The proposed tactile-driven adaptation strategy effectively bridges the embodiment gap by translating human tracking intents into precise robotic commands, utilizing real-time optimization and localized corrections based on fingertip force-sensing profiles. Experimental evaluations demonstrate that DexTeleop-0 outperforms traditional methods, achieving higher task success rates and improved efficiency in complex manipulation scenarios.
Tactile feedback transforms bimanual teleoperation, enabling robots to execute complex tasks with unprecedented precision and efficiency.
Fine-grained, bimanual dexterous manipulation remains a foundational challenge in robotics. Traditional teleoperation systems often fail in contact-rich tasks because embodiment gaps hinder accurate kinematic mapping, while tactile and force feedback remain absent. Consequently, data collection efficiency for high-precision tasks remains prohibitively low. To address these limitations, we propose a tactile-driven adaptation strategy designed to enable fine-grained manipulation on top of teleoperation pipelines. Instantiated within our bimanual dexterous framework, DexTeleop-0, this strategy introduces a real-time optimization loop that bridges the embodiment gap by translating coarse human tracking intents into precise, force-compliant robotic commands with tactile sensing. By estimating accurate contact points and leveraging a tactile-enabled fingertip force-sensing profile, the system dynamically computes localized corrections using the operational space Jacobian with respect to joint angle updates. We rigorously evaluate this tactile-driven adaptation strategy across both simulated environments and real-world hardware. Compared with representative baselines, the proposed method consistently achieves higher task success rates and improved execution efficiency in robust grasping, disturbance-resilient manipulation, and complex dexterous tasks.
