Search papers, labs, and topics across Lattice.
The paper introduces Failure-Aware Retry (FAR), a novel framework that enables robots to autonomously learn from failures encountered during real-world tasks, thereby improving their recovery strategies without human intervention. By integrating Failure-Contrastive Preference Adaptation and lightweight action perturbations, FAR effectively steers robot policies away from previous mistakes while promoting local exploration during retries. Experimental results demonstrate that FAR enhances success rates by an average of 17.6% in simulation and 11.7% in real-world scenarios, while also improving data efficiency in continual policy improvement.
Robots can now autonomously learn from their failures, boosting success rates by over 17% without human intervention.
Robot policies inevitably encounter failures when deployed in real environments. Naive retries often repeat the same mistakes, while many existing recovery methods rely on human intervention. In this paper, we propose Failure-Aware Retry (FAR), a framework that enables robots to learn from previous failures at test time, adapt their behavior accordingly, and eventually complete the task autonomously. FAR combines Failure-Contrastive Preference Adaptation, which constructs preference learning data from failures to steer the policy away from previously unsuccessful behaviors, with lightweight action perturbations during retries to encourage local exploration. We further incorporate successful recovery trajectories into a training loop for continual policy improvement. Experiments in both simulation and real-world manipulation tasks show that FAR substantially improves success rates and robustness, with average gains of 17.6% over the standard diffusion policy in simulation and 11.7% in the real world. In addition, FAR significantly improves data efficiency under both reset and timestep budgets during continual policy improvement by exploiting informative failure cases.
CMU ML