Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
To eliminate the cost and task-overfitting inherent to reward-driven agent optimization, SelfSearch enables LLM agents to iteratively refactor their instructions, tools, and execution harnesses without downstream task rewards. The approach drives harness evolution purely by reflecting on the structured traces—reasoning, tool calls, and error profiles—of prior self-modification episodes. Across six model-benchmark settings, reward-free SelfSearch improved baseline population-mean success, posting up to an 11.2 percentage-point gain on Terminal-Bench 2.1 and matching top-tier harness performance for just $4.03 in search compute.
Self-improving coding agents do not require downstream reward signals to evolve: bootstrapping purely from historical self-modification traces matches the performance of benchmark-guided search at a fraction of the cost.
Advances in the coding capabilities of LLM agents allow them to inspect and modify their own instructions, tools, and execution procedures. Existing approaches use this ability to search for improved agents through repeated downstream evaluation, which incurs substantial costs and ties the search to the evaluated tasks. We introduce \textbf{SelfSearch}, a reward-free search procedure in which agents modify themselves using records of previous self-improvement episodes. These records capture the reasoning, tool actions, and outcomes of earlier modification attempts, providing concrete experience for improving both task solving and self-modification. Without downstream reward signals during search, SelfSearch improves population-mean success over the initial agent in all six model--benchmark settings, with individual agents gaining up to 11.2 percentage points on Terminal-Bench 2.1. On SWE-bench Multilingual, an agent improves success by \textbf{5.0} percentage points while reducing execution cost by \textbf{38.5}\% on tasks solved by both the initial and evolved agents. SelfSearch achieves competitive task success with evaluation-guided search baselines at lower search cost. With only \textbf{\$4.03} in search cost, it produces a harness that solves \textbf{82.0}\% of Terminal-Bench 2.1 tasks with DeepSeek V4 Flash under the settings of a public nine-harness comparison, matching the top-scoring harness, Codex. These results suggest that experience gained through self-modification can improve agents' downstream capabilities and efficiency.