Search papers, labs, and topics across Lattice.
This paper explores Playful Agentic Robot Learning, where embodied coding agents utilize self-directed play to acquire reusable skills before tackling specific tasks. The authors introduce Robotics Agent Teams (RATs) that engage in exploratory tasks, enabling robots to plan, execute, and refine their coding policies through iterative feedback and skill distillation. Experiments demonstrate that skills learned through play significantly enhance performance on downstream tasks, achieving up to 20.6 percentage-point improvements over traditional methods in benchmark environments.
Playful learning strategies enable robots to acquire skills that boost performance on new tasks by over 20%, transforming how we approach robotic skill acquisition.
Current agentic robot systems can write executable Code-as-Policy programs, observe feedback, and revise behavior across multiple attempts, but they remain largely task-driven: reusable skills are acquired only after explicit instructions. We study Playful Agentic Robot Learning, where an embodied coding agent uses self-directed play as a continual skill-learning stage before downstream tasks arrive. We introduce RATs, Robotics Agent Teams designed for play-time skill acquisition. During play, RATs proposes novel yet learnable exploratory tasks, plans and executes robot-code policies, verifies intermediate progress, diagnoses failures, retries with dense, step-level feedback, and distills successful executions into a persistent code skill library. At test time, the agent reuses relevant skills from this frozen library to help solve new tasks. Experiments in LIBERO-PRO and MolmoSpaces show that play-learned skills improve held-out downstream tasks over no-play and random-play baselines, with 20.6 and 17.0 percentage-point gains over CaP-Agent0 on LIBERO-PRO and MolmoSpaces, respectively. Moreover, the learned skills can be plugged into other inference-time Code-as-Policy agents by simply retrieving them into the context, improving RoboSuite and real-world transfer by 8.9 and 8.8 points, respectively, without finetuning the underlying model.
Amazon Science
BAIR