Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
To mitigate the quadratic token overhead of accumulating interaction transcripts in long-horizon agents, this work investigates Continuous Context Management (CCM), an inference regime where agents emit an updated memory state alongside each action to maintain constant-sized active prompts. While zero-shot CCM substantially cuts token consumption at the cost of task completion for most frontier models, the authors recover this degradation in open-weight models using GRPO augmented with privileged full-history distillation. On WebShop, this distillation approach substantially closes the gap, allowing a Qwen3-4B-Instruct CCM agent to outperform its full-history GRPO counterpart while dramatically shrinking the active context footprint.
LLM agents can ditch unwieldy context windows entirely: compacting memory at every single turn matches or beats full-history baselines when guided by privileged full-context distillation.
Long-horizon large language model (LLM) agents commonly retain their complete interaction history until compaction is triggered at a predefined threshold. We study Continuous Context Management (CCM), which performs compaction at every turn to prevent interaction history from accumulating in the active prompt. At each turn, a CCM agent emits an updated memory together with an environment action; its next prompt contains the original task, retained memory, and newest observation rather than the complete transcript. We first evaluate CCM without fine-tuning on TerminalBench-2 using Claude Sonnet 4.6, Claude Opus 4.6, GLM-5, and Kimi K3. CCM substantially reduces cumulative input usage and active-prompt size, although it lowers task success for most models while preserving performance for Kimi K3. We use GRPO with privileged full-history distillation to improve CCM in open-weight models. A frozen copy of the student's initial model scores each sampled student action under the complete history reconstructed from that student's rollout, providing dense action-token supervision without a separate teacher rollout or reference solution. On WebShop, this objective substantially improves CCM over GRPO at both evaluated model scales and surpasses full-history GRPO for Qwen3-4B-Instruct, though not for Qwen3-8B. On Endless Terminals, the augmented method provides a modest improvement over GRPO, with both CCM policies outperforming the untrained full-history baseline. These results demonstrate that CCM is a viable inference paradigm for agents operating with substantially reduced retained context and that its performance can be improved through reinforcement learning with privileged full-history distillation.