Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
RoboRSI enables robots to autonomously improve their code-based skills by organizing learning around task decomposition and explicit skill contracts, ensuring repairs are attributed, evidenced, and validated before reuse. This system, employing a Manager, Planner, Engineer, and Reviewer, successfully developed multi-object household cleanup capabilities on a physical robot and achieved state-of-the-art performance across multiple simulation benchmarks. The core innovation lies in Top-Down Skill Refinement (TSR), which structures experience to facilitate stable, reusable skill consolidation.
Robots can now evolve their own code, learning from task execution to autonomously repair and reuse skills, achieving superior performance on complex manipulation benchmarks.
A generalist robot should not only perform diverse tasks but also improve through experience, turning what it learns during execution into capabilities that later tasks can reuse. Robot agents that act through code can already repair programs from execution feedback, yet it remains a central challenge to organize this experience around the task structure that gives it meaning, so that each repair is attributed to the responsible capability, supported by execution evidence, and validated before it is reused. We introduce RoboRSI, a robot self-improvement system built on Top-Down Skill Refinement (TSR). TSR decomposes tasks into compound, atomic, and base skills with scoped responsibilities and explicit input--output contracts, attributes each execution outcome to the responsible branch, and confines revision to that branch. Building upon this structure, a Manager, Planner, Engineer, and Reviewer coordinate planning, execution, diagnosis, and the validated release of new skills, while people steer the process through objectives and corrections; stable skill sequences are further consolidated into reusable compound skills. On a mobile manipulator, RoboRSI develops multi-object household cleanup over 104 rounds. In simulation, it achieves the highest success rate on LIBERO, LIBERO-PRO, LIBERO-Plus, and RoboTwin, exceeding the strongest baseline by 2.7 to 11.0 percentage points.