Track trials, findings, and clinical evidence as it lands.
Search papers, labs, and topics across Lattice.
This paper introduces Collective Experience Learning (CEL), a paradigm where deployed robots share execution data to collaboratively improve a single policy, addressing the scalability challenges of human-corrected learning. CEL is implemented via Failure-Guided Experience Retrieval fine-tuning (FERT), which leverages failure contexts to retrieve and supervise policy updates using successful fleet experience, eliminating the need for new expert interventions. The FERT approach, coordinated by a Fault-Tolerant Asynchronous Training System (FATS), demonstrates significant policy reliability improvements across five real-world manipulation tasks, with larger fleets yielding progressively higher success rates.
Robots can learn from fleet-wide failures and successes to autonomously improve their policies, achieving near-perfect reliability without any new human corrections.
Experience generated during deployment offers an opportunity for robots to improve policy reliability through learning from their own executions. However, learning through human corrections requires teleoperators to monitor execution and intervene when policies fail, a demand that is difficult to meet as robot fleets grow. We introduce collective experience learning (CEL), a learning paradigm in which deployed robots share their execution experience to improve a common policy. We realize CEL through failure-guided experience retrieval fine-tuning (FERT), which uses failure contexts from robot executions to retrieve relevant trajectory segments from the fleet's shared successful experience and uses their actions as supervision for policy updates, without collecting additional expert demonstrations or corrective actions. A fault-tolerant asynchronous training system (FATS) coordinates experience collection, policy optimization and policy distribution despite local interruptions within the robot fleet. Across five real-world manipulation tasks, the resulting policies achieve success rates of 93.3-99.2%, evaluated over 120 trials per task on robots excluded from training data collection. With collection time per robot held fixed, larger fleets provide more experience and FERT generally achieves higher success rates across the evaluated sizes. On multi-stage phone packaging, learning with 96 robots increases success from 79.2% to 98.3%. These results support collective experience as a practical basis for scalable robot learning and a path towards improving policy reliability during deployment without collecting additional expert corrective actions.