Search papers, labs, and topics across Lattice.
This paper introduces a self-supervised framework for humanoid loco-manipulation that leverages sparse demonstrations to learn a goal-conditioned policy with minimal expert intervention. By integrating diffusion-based trajectory generation with reinforcement learning, the method enables the automatic exploration of the goal space, addressing the challenges of high demonstration costs and policy failure corrections. Extensive evaluations reveal that this approach significantly enhances the learning of diverse loco-manipulation skills compared to existing state-of-the-art methods.
Sparse demonstrations can now effectively bootstrap humanoid loco-manipulation learning, reducing the need for constant human oversight.
Imitating human demonstrations has emerged as a dominant paradigm for learning humanoid loco-manipulation policies. However, scaling these approaches remains challenging due to the high cost of collecting diverse demonstrations and the need for continual human intervention to correct policy failures. In this paper, we present a self-supervised framework that bootstraps from sparse demonstrations and progressively expands its behavioral repertoire, enabling the learning of a goal-conditioned policy that automatically explores the goal space with minimal expert supervision. Our approach combines diffusion-based trajectory generation with reinforcement learning, where the latter is used to track goal-conditioned trajectories produced by the diffusion model for a range of loco-manipulation skills. Through extensive ablation studies and comparisons with state-of-the-art methods, we demonstrate the effectiveness of our framework on multiple humanoid loco-manipulation skills.
