Search papers, labs, and topics across Lattice.
This paper introduces the L0-L5 framework to define and analyze Physical Recursive Self-Improvement (Physical RSI), where robots autonomously enhance their capabilities and learning processes through physical experience. Despite advancements in autonomous task execution and learning, the authors find that current literature does not yet demonstrate true Physical RSI, highlighting significant challenges in reliable feedback, causal attribution, and safety. The work identifies key research priorities to enable robots that can recursively improve their own learning mechanisms while maintaining safety.
Robots can't truly improve themselves yet; current systems lack the crucial ability to recursively refine their own learning processes based on physical experience.
Robots are increasingly autonomous in task execution, yet their improvement remains largely human-driven. This study investigates Physical Recursive Self-Improvement (Physical RSI), in which physical experience guides lasting updates to both a robot's capabilities and its improvement procedure, making subsequent improvement more effective across tasks. Physical RSI faces challenges from noisy observations, continuous dynamics, costly trials, and irreversible consequences. We present an L0-L5 framework that differentiates capability-level from meta-level updates and within-task from across-task gains, reserving L5 for independently verified recursive gain. We study existing methods around harness adaptation and model training, alongside safety and control mechanisms that govern execution and successive updates. Our analysis reveals that, despite substantial progress in self-improvement, the surveyed literature does not yet demonstrate Physical RSI as defined by our framework. We identify research priorities in reliable feedback, causal attribution, safety preservation, and benchmarking, outlining a path toward robots that autonomously improve how they learn while ensuring safety. The GitHub repository for Physical RSI is available at https://github.com/SAIL-Research-Lab/Physical-RSI.