Search papers, labs, and topics across Lattice.
This paper introduces Infini Memory, a novel architecture for long-term LLM agent memory that organizes information into topic-structured documents, enhancing the ability to track evolving facts and maintain relevant evidence across sessions. By staging new observations in a buffer and consolidating them into coherent contexts, the system allows for more effective memory maintenance and fact revision. The results on MemoryAgentBench demonstrate a significant improvement in memory performance, achieving an overall score of 64.7%, with ablation studies highlighting the benefits of topic structure and iterative retrieval processes.
Infini Memory redefines long-term memory for LLMs, achieving a 64.7% score on MemoryAgentBench by structuring memory as topic documents that evolve over time.
Long-term LLM agents need persistent memory that can track changing facts and provide relevant evidence across sessions. Existing memory systems often store observations as isolated records, summaries, or indexed fragments, which makes evidence aggregation, fact revision, and memory maintenance difficult. We propose Infini Memory, a maintainable text-based persistent memory architecture that treats agent memory as topic-structured documents. Each topic document serves as a semantic unit for collecting related evidence, preserving metadata, and revising facts over time. New observations are first staged in a buffer and periodically consolidated into coherent textual contexts. At inference time, an agentic retrieval procedure lets the LLM read memory through iterative tool calls rather than a single retrieval step. On MemoryAgentBench, Infini Memory achieves 64.7% overall score. Ablations show that topic-structured maintenance and iterative evidence inspection improve complementary aspects of long-term memory use.
Tsinghua AI