Search papers, labs, and topics across Lattice.
This paper introduces the Multimodal Diffusion Policy (MulDP) for autonomous quadruped navigation, addressing the challenges of fine-grained velocity regulation and long-horizon anticipatory behaviors in complex terrains. By integrating visual perception with proprioceptive feedback and goal information, MulDP generates temporally coherent navigation commands that enhance the robot's ability to navigate autonomously without human intervention. The authors also present the Quadruped Parkour Navigation Dataset (QPND), which supports the training of MulDP and shows that it significantly improves performance in both simulation and real-world scenarios.
Autonomous quadrupeds can now navigate complex terrains without human intervention, thanks to a novel multimodal approach that integrates perception and control.
Quadruped robots have demonstrated impressive agility in parkour locomotion across complex terrains. However, most systems still rely on human intervention for high-level planning, and autonomous parkour navigation remains underexplored. The key challenges include fine-grained velocity regulation, long-horizon anticipatory behaviors, and tight coupling between perception and embodied execution. To address these challenges, we propose a Multimodal Diffusion Policy (MulDP) that integrates visual perception with robot proprioception and goal information to generate temporally coherent and anticipatory navigation velocity commands, tightly coupling perception with embodied control to enable robust autonomous navigation. To support the training of MulDP, we construct the first Quadruped Parkour Navigation Dataset (QPND), a multimodal dataset that encompasses diverse navigation behaviors and complex terrains. Extensive simulation and real-world experiments demonstrate that MulDP enables robust long-horizon autonomous navigation and effective traversal across complex terrains.
