Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
EmbodiedRSI addresses the performance degradation of robot foundation models in dynamic environments by introducing an active continual learning harness that efficiently utilizes robot trials for code and skill improvement. It employs a Fast-Slow Dual-System Architecture with a Hypothesis Graph and Value-of-Information Experiment Selection to guide physical interactions and co-evolve code and skills. This approach achieves state-of-the-art performance on RoboCasa365 and LIBERO-Pro, and demonstrates strong zero-shot transfer to real-world robots.
Physical robot learning can now autonomously discover and exploit informative experiments to continuously improve foundation models, achieving 77% success on RoboCasa365 and zero-shot transfer to real hardware.
Robot foundation models provide strong visuomotor control, yet their performance can degrade when object positions or task instructions change. Further improvements often require post-training on substantial robot data, which can be costly to collect through methods such as teleoperation. Agentic harnesses can adapt around the model, but current self-evolving harnesses use robot trials inefficiently when deciding which code and skill changes to pursue. We introduce EmbodiedRSI, a self-evolving agentic harness that autonomously decides where to explore next and turns the resulting physical interaction into improved code and skills. EmbodiedRSI realizes this through a Fast-Slow Dual-System Architecture, in which competing code and skill hypotheses are maintained in a Hypothesis Graph. Value-of-Information Experiment Selection chooses physical experiments that can distinguish these hypotheses. Their outcomes guide Code-Skill Co-Evolution. The Slow System builds Hierarchical Memory, and Reward-Grounded Memory Learning selects effective memory according to their value for later Fast-System improvement. On RoboCasa365, EmbodiedRSI reaches 77.0% overall success and 71.3% on Composite-Unseen, compared with 40.1% for the best baseline. EmbodiedRSI also reaches 86.8% overall success on LIBERO-Pro. Beyond benchmark performance, EmbodiedRSI transfers zero-shot to real-world robot, achieving 71.3% overall success across multiple challenging tasks.