Search papers, labs, and topics across Lattice.
This paper addresses the challenge of sequential skill learning in robots, focusing on maintaining a shared policy structure while adding new skills. The authors introduce the "Sleeping Robots" framework, which utilizes a wake-sleep approach to consolidate skills offline using frozen skill memories and differentiable surrogate objectives, effectively mitigating skill-coupling collapse. Experimental results on Meta-World MT5 show a 64% improvement in average success and a twofold increase in pairwise reliability compared to the best non-oracle baseline, demonstrating significant advancements in robot learning efficiency and reliability.
Robots can learn new skills without sacrificing the reliability of previously acquired abilities, achieving a 64% boost in success rates through an innovative wake-sleep consolidation method.
Robots that learn over long deployments must add new skills without losing the shared policy structure that makes earlier skills reusable. We study sequential robot skill learning, where previous trajectories and task losses may be unavailable, and the deployed policy must remain a single shared controller without task-specific heads, routing, or adapters. We identify skill-coupling collapse, a failure mode in which individual skill success remains non-trivial while reliability among related skills deteriorates. We propose Sleeping Robots, a wake-sleep framework that learns each new skill during wake and consolidates the shared policy offline during sleep using compact frozen skill memories: frozen critics with unordered state buffers for reinforcement learning and frozen actor snapshots with unordered observation buffers for imitation learning. During sleep, these memories define differentiable surrogate objectives whose gradients are combined through Nash bargaining, with adaptive anchoring and local excitability for stable consolidation. On Meta-World MT5, Sleeping Robots improves average success by 64 % and pairwise reliability by x 2.0 over the strongest non-oracle baseline, and on SurgicAI it improves average success and backward transfer relative to continual imitation baselines while remaining competitive on pairwise reliability.
