Search papers, labs, and topics across Lattice.
The paper introduces AdaptManip, a reinforcement learning-based framework for humanoid robots to perform integrated navigation, object lifting, and delivery without relying on human demonstrations. AdaptManip consists of a recurrent object state estimator, a whole-body base policy for locomotion and manipulation, and a LiDAR-based robot global position estimator, all trained in simulation. Experimental results demonstrate that AdaptManip outperforms imitation learning baselines in adaptability and success rate, achieving zero-shot transfer to real-world navigation, lifting, and delivery tasks.
Humanoid robots can now learn robust object manipulation and navigation entirely through reinforcement learning, surpassing imitation learning methods in real-world adaptability.
This paper presents Adaptive Whole-body Loco-Manipulation, AdaptManip, a fully autonomous framework for humanoid robots to perform integrated navigation, object lifting, and delivery. Unlike prior imitation learning-based approaches that rely on human demonstrations and are often brittle to disturbances, AdaptManip aims to train a robust loco-manipulation policy via reinforcement learning without human demonstrations or teleoperation data. The proposed framework consists of three coupled components: (1) a recurrent object state estimator that tracks the manipulated object in real time under limited field-of-view and occlusions; (2) a whole-body base policy for robust locomotion with residual manipulation control for stable object lifting and delivery; and (3) a LiDAR-based robot global position estimator that provides drift-robust localization. All components are trained in simulation using reinforcement learning and deployed on real hardware in a zero-shot manner. Experimental results show that AdaptManip significantly outperforms baseline methods, including imitation learning-based approaches, in adaptability and overall success rate, while accurate object state estimation improves manipulation performance even under occlusion. We further demonstrate fully autonomous real-world navigation, object lifting, and delivery on a humanoid robot.
