Search papers, labs, and topics across Lattice.
This paper replicates and extends the state-in-context agent framework by re-implementing the DirectSolve variant and evaluating it on the SWE-bench Verified benchmark using GPT-5-mini and GPT-4.1. The authors investigate the impact of token-reducing input transformation strategies, specifically focusing on code minification techniques that maintain program semantics while significantly reducing token consumption. Results indicate a 42% reduction in average input token usage, albeit with a 12 percentage-point decrease in resolution rate, highlighting a trade-off between efficiency and performance in software engineering agents.
Minification techniques can cut token usage by 42% in state-in-context agents, but at the cost of a notable drop in resolution rate.
This paper presents a replication and extension of the recently introduced state-in-context agent framework. We independently re-implement the DirectSolve variant and evaluate it on the SWE-bench Verified benchmark. We report end-to-end full-benchmark results using GPT-5-mini and run selected ablations with GPT-4.1. In addition, we investigate a complementary research question: What is the impact of token-reducing input transformation strategies on the performance of software engineering agents? Based on a preliminary prompt analysis, we identify source code as the dominant contributor to token consumption. We therefore apply a series of code minification techniques that remove or shorten non-essential lexical elements while preserving program semantics. The proposed transformations are integrated into the agent and systematically evaluated. Experiments show that minification reduces average input token usage by 42% with a 12 percentage-point drop in resolution rate. These findings demonstrate that lightweight source code transformations can yield substantial efficiency gains while retaining a substantial fraction of the baseline performance, indicating a promising path toward more cost-effective agents. The full implementation is publicly available on GitHub: https://github.com/ipa-lab/minified-state-in-context-agent
