Search papers, labs, and topics across Lattice.
The paper introduces the Adaptive Context Elasticizer (ACE), a modular solution designed to enhance context management in large language model (LLM) agents facing increasingly complex tasks. By implementing a reversible design that retains both raw and compressed historical information, ACE allows agents to dynamically adjust their context based on the current task state, overcoming the limitations of traditional methods like truncation and summarization. Experimental results demonstrate that ACE significantly improves performance across multiple agent frameworks, showcasing its versatility and effectiveness in maintaining an information-rich context.
ACE revolutionizes context management for LLM agents, enabling them to adaptively retain critical information without loss, leading to superior decision-making performance.
The increasing complexity of agentic tasks has led to rapidly growing trajectory lengths, which poses significant challenges for large language model (LLM) based agents with fixed context windows. Existing context management techniques, such as truncation and summarization, suffer from inherent inflexibility and irreversibility: once information is discarded or compressed, it cannot be recovered even when it becomes critically relevant in later decision steps. To address these limitations, we propose the Adaptive Context Elasticizer (ACE), a plug-and-play module that elastically orchestrates historical step information into the agent's context at each decision step. ACE maintains a lossless message maintenance layer that stores both raw messages and compressed abstractions for each historical step, while a context orchestration layer adaptively assigns each step an elastic type as raw, abstract, or drop, at every decision step based on the current task state. This reversible design ensures that the main LLM always receives a compact yet information-rich context. We adapt ACE to four diverse agent frameworks, including ReAct, DeepAgent, WebThinker, and MiroFlow, without training or architectural modifications. Experiments show that ACE consistently outperforms truncation and summarization baselines, and brings consistent performance gains across all four agent frameworks.
