Search papers, labs, and topics across Lattice.
This paper introduces AutoSERL, a novel framework that enables robotic reinforcement learning (RL) using only a single demonstration, addressing the challenges of costly data collection and the need for continuous human intervention. AutoSERL incorporates a sliding window intervention mechanism, a safety recovery mechanism, and an intervention termination criterion to guide exploration, correct failures, and autonomously transition to independent task execution. Evaluated on six manipulation tasks across two robot platforms, AutoSERL outperforms existing methods, achieving a 100% success rate on insertion tasks and demonstrating enhanced robustness to positional variations.
Achieving 100% success on complex robotic tasks with just one demonstration could revolutionize how we approach real-world robotic learning.
Learning effective robot control policies on physical hardware is challenging due to costly data collection and the difficulty of reward specification. Prior work has incorporated demonstrations into reinforcement learning (RL), yet existing approaches either require large numbers of demonstrations or depend on continuous human intervention during training. To address these limitations, we present AutoSERL, a framework that leverages a single demonstration to fully automate the intervention process in real-world robot RL. The framework includes three complementary mechanisms to accomplish certain tasks: a sliding window intervention mechanism that continuously guides exploration to prevent local optima and unsafe deviations, a safety recovery mechanism that detects and corrects failure states via predefined trajectory recovery points, and an intervention termination criterion that automatically disables guidance once the policy can independently complete the task, preserving its exploration advantage. We evaluate AutoSERL on six contact-intensive manipulation tasks across two robot platforms, spanning insertion, hanging, and hinge-based tasks. AutoSERL consistently outperforms SERL initialized with 20 demonstrations, behavior cloning, and MILES -- a dedicated one-shot imitation learning baseline -- across all tasks while matching HIL-SERL, achieves 100% success rate on insertion tasks, and demonstrates improved robustness to positional variations, all from a single demonstration. Code and videos are available on our project website: https://autoserl.github.io/.
