Search papers, labs, and topics across Lattice.
To address context window saturation and reasoning degradation caused by verbose trial-and-error trajectories in autonomous coding agents, the authors develop AttnCompress, a dynamic attention-guided trajectory compression framework. The system preserves syntactic integrity and non-linear task dependencies by combining perplexity-spike segmentation, proxy attention relevance scoring, and a dynamic rolling recall window. On SWE-Bench-Verified and Multi-SWE-Bench, it achieves a state-of-the-art 53.17% pass rate while cutting token consumption by 21.6% and end-to-end execution costs by 33.6%.
Autonomous coding agents can slash inference costs by 33% and actually *improve* task success on SWE-Bench, proving that dynamic, syntax-aware context pruning enhances long-horizon reasoning rather than compromising it.
The transition from human-centric assistance to Autonomous Software Engineering (ASE) agents has enabled the resolution of complex real-world SE tasks. However, the trial-and-error nature of these agents generates lengthy interaction trajectories, creating severe bottlenecks in terms of context window limits and cost. While context compression offers a potential remedy, prior approaches suffer from static pruning strategies and granularity mismatches, often failing to preserve the semantic dependencies and syntactic details crucial for SE tasks. To strictly preserve critical task evidence while reducing context length, we introduce AttnCompress, a dynamic attention-guided trajectory compression framework. Unlike existing approaches, AttnCompress bridges the gap between semantic integrity and dynamic adaptability through three key mechanisms: (1) structure-aware segmentation via perplexity (PPL) spikes to preserve the syntactic structure of code and logs; (2) relevance estimation using proxy attention weights to quantify the precise relevance of historical blocks to the agent's current reasoning; and (3) a dynamic rolling window to re-evaluate and recall historical context as the task evolves. Extensive evaluation on SWE-Bench-Verified and Multi-SWE-Bench demonstrates that AttnCompress achieves a pass rate of 53.17%, outperforming prior state-of-the-art baselines while reducing token consumption by 21.6% and total costs by 33.6%. The framework proves to be model-agnostic and generalizes effectively across diverse programming languages.
