Search papers, labs, and topics across Lattice.
This paper introduces HarnessEvolve, a self-evolving framework designed to enhance agent autonomy by learning from reference trajectories, thereby addressing challenges such as credit assignment failure, shortcut learning, and catastrophic forgetting. By decoupling execution from the evolutionary pipeline and implementing independent modules for execution, evaluation, optimization, and gating, HarnessEvolve achieves stable and generalizable improvements in agent performance. Experimental results show that HarnessEvolve outperforms state-of-the-art baselines across various benchmarks, confirming its reliability and effectiveness in diverse task domains.
HarnessEvolve not only solves the credit assignment problem but also prevents agents from falling into the traps of shortcut learning and catastrophic forgetting, ensuring robust self-evolution.
Self-evolving agents advance toward autonomy by optimizing their harness---prompts, skills, tools, and execution logic---based on environmental feedback. This paradigm, however, is hampered by three challenges: \textit{credit assignment failure}, where terminal success/failure feedback makes it ambiguous which step caused the error; \textit{shortcut learning}, where agents memorize task-specific patterns rather than acquire generalizable capabilities; and \textit{catastrophic forgetting}, where unguarded updates degrade previously acquired competence. In this paper, we introduce HarnessEvolve, a self-evolving framework that learns from reference trajectories to achieve reliable agent self-evolution. HarnessEvolve decouples the execution agent from the evolutionary pipeline, assigning execution, evaluation, optimization, and gating to independent agent modules, enabling generalizable and stable harness improvements. Specifically, HarnessEvolve overcomes credit assignment failure by generating reference trajectories (execution paths produced when given the ground-truth answers) and aligning failed executions against them to extract error signals, which are clustered to reveal systematic failure patterns. To prevent shortcut learning and catastrophic forgetting, candidate harness updates must pass two gates: a quality gate that filters data leakage and prompt bloat, and a performance gate that accepts each update if it improves on the current batch without degrading recent batches, with epoch-end validation on a held-out set selecting the best-performing accepted agent snapshot. We conduct extensive experiments on several benchmarks spanning open-domain and enterprise scenarios, using different models and agent frameworks. Results demonstrate that HarnessEvolve consistently outperforms state-of-the-art baselines across all benchmarks and settings, confirming reliability across task domains.
Tsinghua AI