Search papers, labs, and topics across Lattice.
This paper introduces Agent-CoEvo, a coevolutionary multi-agent framework for repository-level issue resolution, where code patches and test patches are jointly explored and refined. Unlike existing LLM-based repair systems that treat tests as fixed oracles, Agent-CoEvo models tests as dynamic constraints that guide and are revised by the repair process. Evaluations on SWE-bench Lite and SWT-bench Lite demonstrate that Agent-CoEvo outperforms state-of-the-art baselines in both repair success and test reproduction quality, highlighting the importance of enabling repair agents to revise behavioral constraints.
Stop treating tests as immutable oracles: letting repair agents revise behavioral constraints during search dramatically improves issue resolution.
Software engineers resolving repository-level issues do not treat existing tests as immutable correctness oracles. Instead, they iteratively refine both code and the tests used to characterize intended behavior, as new modifications expose missing assumptions or misinterpreted failure conditions. In contrast, most existing large language model (LLM)-based repair systems adopt a linear pipeline in which tests or other validation signals act mostly as post-hoc filters, treating behavioral constraints as fixed during repair. This formulation reduces repair to optimizing code under static and potentially misaligned constraints, leading to under-constrained search and brittle or overfitted fixes. We argue that repository-level issue resolution is fundamentally not optimization under fixed tests, but search over evolving behavioral constraints. To operationalize this view, we propose Agent-CoEvo, a coevolutionary multi-agent framework in which candidate code patches and test patches are jointly explored and iteratively refined. Rather than treating tests as immutable oracles, our framework models them as dynamic constraints that both guide and are revised by the repair process. Through mutual evaluation and semantic recombination, code and test candidates progressively narrow the space of behavior consistent with the issue description. Evaluated on SWE-bench Lite and SWT-bench Lite, Agent-CoEvo consistently outperforms state-of-the-art agent-based and agentless baselines in both repair success and test reproduction quality. Our findings suggest that enabling repair agents to revise behavioral constraints during search is critical for reliable issue resolution, pointing toward a shift from code-only optimization to coevolution of implementation and specification.
