Search papers, labs, and topics across Lattice.
The paper introduces MemMA, a multi-agent framework that coordinates the memory cycle of memory-augmented LLMs by using a Meta-Thinker to strategically guide memory construction and retrieval, and by implementing in-situ self-evolving memory construction to repair the memory bank. This approach addresses the limitations of existing systems that treat memory construction, retrieval, and utilization as isolated subroutines, leading to strategic blindness and sparse supervision. Experiments on the LoCoMo benchmark demonstrate that MemMA outperforms existing baselines across multiple LLM backbones and improves different storage backends.
Memory-augmented LLMs get a strategic upgrade: MemMA uses multi-agent reasoning to proactively guide memory construction and repair, leading to significant performance gains.
Memory-augmented LLM agents maintain external memory banks to support long-horizon interaction, yet most existing systems treat construction, retrieval, and utilization as isolated subroutines. This creates two coupled challenges: strategic blindness on the forward path of the memory cycle, where construction and retrieval are driven by local heuristics rather than explicit strategic reasoning, and sparse, delayed supervision on the backward path, where downstream failures rarely translate into direct repairs of the memory bank. To address these challenges, we propose MemMA, a plug-and-play multi-agent framework that coordinates the memory cycle along both the forward and backward paths. On the forward path, a Meta-Thinker produces structured guidance that steers a Memory Manager during construction and directs a Query Reasoner during iterative retrieval. On the backward path, MemMA introduces in-situ self-evolving memory construction, which synthesizes probe QA pairs, verifies the current memory, and converts failures into repair actions before the memory is finalized. Extensive experiments on LoCoMo show that MemMA consistently outperforms existing baselines across multiple LLM backbones and improves three different storage backends in a plug-and-play manner. Our code is publicly available at https://github.com/ventr1c/memma.
Amazon Science