Search papers, labs, and topics across Lattice.
This paper introduces Dual-Process Atomic Skill Learning (DASL), an innovative framework that separates semantic reasoning from real-time control in language-conditioned imitation learning for robots. By employing a Slow-Frequency Policy for discrete skill prediction and a High-Frequency Policy for precise action generation, DASL effectively addresses the training instability and codebook collapse issues prevalent in existing hierarchical methods. Experimental results show that DASL significantly outperforms state-of-the-art approaches in skill acquisition and generalization to novel multi-step tasks, marking a substantial advancement in robotic learning capabilities.
Decoupling semantic reasoning from real-time control allows robots to master complex tasks with unprecedented stability and generalization.
Language-conditioned Imitation Learning (IL) is essential for enabling robots to perform complex tasks following natural language instructions. However, generalizing to multi-step compositional tasks remains a significant challenge. While hierarchical approaches attempt to address this by decomposing tasks into atomic skills, existing methods often suffer from training instability and codebook collapse due to the tight coupling between high-level skill reasoning and low-level action generation in joint training paradigms. Inspired by the Dual-Process Theory of cognition, we propose Dual-Process Atomic Skill Learning (DASL), a novel asynchronous hierarchical imitation learning framework that decouples slow semantic reasoning from fast, real-time motion control. DASL comprises a Slow-Frequency Policy that predicts interpretable, discrete skills via Vector Quantization, and a High-Frequency Policy that leverages a latent diffusion model and a Decision Transformer to generate precise actions conditioned on these latent skills. By asynchronously coordinating these modules and utilizing diffusion to structure the latent space, our framework mitigates the skill codebook interference problem common in joint training paradigms. Evaluations across simulation benchmarks and experiment demonstrate that DASL significantly outperforms state-of-the-art baselines, excelling in skill acquisition and compositional generalization to unseen instructions. GitHub page: https://github.com/Hatakekaka/DASL
