Search papers, labs, and topics across Lattice.
This paper introduces a hierarchical reinforcement learning framework for quadrupedal loco-manipulation that incorporates tactile sensing. A high-level policy, trained on human demonstrations, predicts end-effector trajectories and desired tactile interaction cues, which are then tracked by a low-level, tactile-aware whole-body control policy trained via RL in simulation. The approach achieves a 28.54% performance improvement over vision-only and visuotactile baselines on real-world contact-rich tasks like in-hand reorientation and valve tightening.
Quadruped robots can now perform contact-rich manipulation with significantly improved dexterity by learning to "feel" their way through tasks.
Quadrupedal loco-manipulation is commonly built on visual perception and proprioception. Yet reliable contact-rich manipulation remains difficult: vision and proprioception alone cannot resolve uncertain, evolving interactions with the environment. Tactile sensing offers direct contact observability, but scalable tactile-aware learning framework for quadrupedal loco-manipulation is still underexplored. In this paper, we present a tactile-aware loco-manipulation policy learning pipeline with a hierarchical structure. Our approach has two key components. First, we leverage real-world human demonstrations to train a tactile-conditioned visuotactile high-level policy. This policy predicts not only end-effector trajectories for manipulation, but also the evolving tactile interaction cues that characterize how contact should develop over time. Second, we perform large-scale reinforcement learning in simulation to learn a tactile-aware whole-body control policy that tracks diverse commanded trajectories and tactile interaction cues, and transfers zero-shot to the real world. Together, these components enable coordinated locomotion and manipulation under contact-rich scenarios. We evaluate the system on real-world contact-rich tasks, including in-hand reorientation with insertion, valve tightening, and delicate object manipulation. Compared to vision-only and visuotactile baselines, our method improves performance by 28.54% on average across these tasks.
