Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper addresses the critical issue of terminal agent failure in long-running coding tasks by introducing ReTerm, a self-improving agent trained to recover from its own errors. A novel dataset, ReTerm-10K, and an online reinforcement learning algorithm, ReTerm-GRPO, are developed to facilitate this recovery learning process. ReTerm-9B demonstrates significant improvements, achieving 34.8% Pass@1 on Terminal-Bench 2.0, a 14.6-point gain over the base model, with enhanced recovery rates across various error types.
Terminal agents can learn to overcome their own mistakes, achieving a 14.6-point Pass@1 improvement on complex coding benchmarks by recovering from failures.
Terminal agents have shown strong abilities in complex coding tasks. However, they often struggle to recover from errors during long-running execution (e.g., command errors, faulty implementations), eventually leading to task failures. To this end, we present ReTerm, a self-improving terminal agent trained by learning how to recover from its own failed terminal tasks. To support its training, we construct a customized data pipeline and produce ReTerm-10K, a high-quality dataset that provides effective recovery demonstrations for SFT cold start. Furthermore, we propose ReTerm-GRPO, an online RL algorithm that forks from the agent's own failure states to generate multiple independent self-recovery attempts. By learning from whether these attempts successfully complete the task, the agent self-improves through its own recovery experience. Built on Qwen3.5-9B, our ReTerm-9B achieves 34.8% Pass@1 on Terminal-Bench 2.0, improving over the base model by 14.6 points. Further analysis shows that our method achieves consistently higher recovery rates across diverse error categories compared with standard GRPO training. All code, data and model are released at https://github.com/twothsnd/ReTerm.
Tsinghua AI