Search papers, labs, and topics across Lattice.
This paper trains a reinforcement learning agent to perform code search using only a standard Unix terminal, foregoing complex tools like repository graphs. They focus on environment repurposing, reward design, and RL optimization within existing coding agent frameworks. The resulting CodeScout models achieve superior or competitive performance compared to much larger LLMs on SWE-Bench benchmarks, and sometimes approach the performance of closed models like Claude Sonnet.
Forget specialized tools: a standard Unix terminal and clever RL are all you need to beat much larger LLMs at code search.
A prerequisite for coding agents to perform tasks on large repositories is code localization - the identification of relevant files, classes, and functions to work on. While repository-level code localization has been performed using embedding-based retrieval approaches such as vector search, recent work has focused on developing agents to localize relevant code either as a standalone precursor to or interleaved with performing actual work. Most prior methods on agentic code search equip the agent with complex, specialized tools, such as repository graphs derived from static analysis. In this paper, we demonstrate that, with an effective reinforcement learning recipe, a coding agent equipped with nothing more than a standard Unix terminal can be trained to achieve strong results. Our experiments on three benchmarks (SWE-Bench Verified, Pro, and Lite) reveal that our models consistently achieve superior or competitive performance over 2-18x larger base and post-trained LLMs and sometimes approach performance provided by closed models like Claude Sonnet, even when using specialized scaffolds. Our work particularly focuses on techniques for re-purposing existing coding agent environments for code search, reward design, and RL optimization. We release the resulting model family, CodeScout, along with all our code and data for the community to build upon.
CMU ML