Search papers, labs, and topics across Lattice.
The paper introduces MemForest, a memory framework for LLM agents designed to address the limitations of existing systems in terms of maintenance overhead and scalability. MemForest employs parallel chunk extraction and a hierarchical temporal index (MemTree) to decouple memory construction into concurrent operations and enable localized per-node updates, replacing full-state rewrites. Evaluations on LongMemEval-S and LoCoMo benchmarks demonstrate that MemForest achieves state-of-the-art performance with significantly higher memory construction throughput compared to existing approaches like EverMemOS.
LLM agents can now maintain long-term memories with 6x higher throughput thanks to a novel hierarchical temporal indexing approach that avoids costly full-state rewrites.
Memory is a fundamental component for enabling long-context LLM agents, supporting persistent state across interactions through a continuous serve-and-update lifecycle. Despite substantial prior work, existing systems suffer from significant maintenance overhead due to two key limitations: coarse-grained state management and inherently sequential update pipelines. In particular, updates are often tightly coupled with LLM inference and require full-state rewrites, leading to poor scalability and growing latency as memory accumulates. To address these challenges, we present MemForest, a memory framework that reformulates agent memory as a write-efficient temporal data management problem. MemForest breaks the sequential bottleneck via parallel chunk extraction, decoupling memory construction into concurrent, independent operations. To further eliminate coarse-grained maintenance, we introduce MemTree, a hierarchical temporal index that organizes memory as time-ordered trees rather than flat global summaries. This design replaces full-state rewrites with localized per-node updates, reducing maintenance cost to the affected tree paths while naturally preserving temporally evolving states. We evaluate MemForest on two long-context memory benchmarks, LongMemEval-S and LoCoMo. On LongMemEval-S, MemForest achieves the best overall performance among stateful baselines, reaching 79.8% pass@1 accuracy while sustaining a memory construction throughput approximately 6x higher than state-of-the-art approaches including EverMemOS.
NUS