Search papers, labs, and topics across Lattice.
This study investigates the internal representations of coding agents by analyzing the residual streams of language models during software-engineering tasks. By employing logistic-regression probes, the authors demonstrate that these models can effectively encode properties of the evolving code, achieving an AUC of up to 0.83 for predicting correctness. Notably, the research reveals that these representations can anticipate the outcomes of future code edits, identifying a "latent programming horizon" that extends up to 25 steps ahead of the agent's actions.
Coding agents can predict the correctness of code changes up to 25 steps in advance, revealing a latent programming horizon that challenges our understanding of their internal reasoning processes.
A coding agent solving a software-engineering task spends dozens of steps reasoning, editing code, and running tests, yet little is known about what the underlying language model internally represents about the program it is working on. We show that the residual streams of language models under coding agents linearly encode properties of the evolving program: a logistic-regression probe on hidden states is able to decode whether the current code parses, passes its test suite, reduces the number of failing tests, and introduces regressions, reaching AUC up to 0.83 for correctness across two models and two benchmarks. Our second finding is more surprising: these representations run ahead of the agent's own edits. Probes trained to predict the outcome of future edits (before they are materialized and written on disk) achieve performance above chance up to roughly 25 steps in advance. We call this the agent's latent programming horizon. As a proof of external validity, we show that the probes transfer across benchmarks without retraining. Our positive results open calls for more research in mechanistic interpretability of coding agents.
