Search papers, labs, and topics across Lattice.
This paper introduces WT-UMI, a tactile-based interface that enhances whole-body humanoid manipulation by integrating human demonstrations and teleoperation data to optimize contact force regulation. The method employs a force-conditioned target-pose correction module to translate human poses into robot-executable targets, while a force-supervised planner predicts end-effector poses and contact-force trajectories. Experimental results demonstrate that WT-UMI significantly improves success rates and reduces tracking errors across various complex manipulation tasks compared to existing policy baselines.
Tactile feedback from WT-UMI enables humanoid robots to achieve superior manipulation performance by effectively bridging the gap between human intuition and robotic execution.
Whole-body humanoid manipulation of bulky, deformable, and shared-load objects requires distributed contact sensing and explicit force regulation, yet most imitation policies treat contact force only implicitly. On the other hand, different demonstration sources provide complementary modalities with inherent trade-offs: human demonstrations capture natural contact forces but not robot-executable actions, while teleoperation directly records robot actions but with less natural force regulation. This paper presents \textbf{WT-UMI}, a wearable whole-body tactile interface worn by human operators or mounted on humanoids, providing accurate observations of tactile images, contact forces, and end-effector poses across both human demonstration and humanoid teleoperation modes. We introduce a force-conditioned target-pose correction module that converts measured human poses into contact-aware robot targets by learning corrections from teleoperation data. To leverage the natural force interaction in human data, we propose a force-supervised planner that predicts end-effector pose chunks and contact-force trajectories. The predicted contact force serves as the reference for a tactile-based admittance controller. Across five contact-rich tasks spanning deformable objects, bulky rigid objects, and human--humanoid collaboration, WT-UMI improves success rate and reduces contact-position tracking error over four policy baselines. Our project page is available at https://wt-umi.github.io/WTUMI/.
