Search papers, labs, and topics across Lattice.
This paper introduces AgentCL, a rigorous evaluation framework for continual learning in language agents that emphasizes the importance of controlled task streams and metrics for assessing transfer gains. By constructing compositional streams that allow for the reuse of earlier solutions in later tasks, the framework reveals significant differences in the performance of non-parametric memory designs compared to naive task streams. Empirical results demonstrate that controlled streams provide clearer insights into memory plasticity and the effectiveness of memory designs, underscoring the necessity for improved architectures that enhance both adaptability and stability.
Controlled task streams reveal that naive memory designs fail to leverage reusable knowledge effectively, exposing critical gaps in continual learning evaluations.
Language agents spend substantial inference time solving individual tasks, yet the experience acquired in one episode is often underutilized in future episodes. Continual learning expects an agent to accumulate reusable experience across a stream of tasks, improve over time, and avoid interference from irrelevant experiences. Unfortunately, existing benchmarks struggle to evaluate continual learning in language agents rigorously. Most efforts focus on retrieval and reasoning over long-context conversations or documents, while recent lifelong-adaptation benchmarks often rely on naive task streams with limited analysis of cross-task relationships, making it difficult to understand what an agent learns and reuses over time. This paper presents an evaluation framework AgentCL for continual learning in agents, centered on controlled task streams and metrics for transfer gains. AgentCL constructs compositional streams where earlier sub-solutions, evidence, or workflows are intentionally reusable in later tasks, and contrasts them with naive streams where such reusability is not guaranteed. We use the benchmark to evaluate non-parametric memory designs for continual learning. To diagnose how memory design choices affect continual learning, we develop MemProbe, a probing method that stores interactions, insights, and skills, while filtering unreliable experiences during consolidation. Empirical analysis across coding, deep research, and language understanding/reasoning tasks shows that naive streams offer limited ability to distinguish memory designs, whereas controlled streams more clearly distinguish their plasticity. Meanwhile, naive and held-out settings often yield limited gains and can expose memory-induced degradation. These results highlight the need for stronger memory designs that balance plasticity and stable reuse.
