Search papers, labs, and topics across Lattice.
This paper introduces MemChain, a novel trainable post-retrieval memory policy designed to enhance the performance of memory-augmented LLM agents by transforming retrieved memories into a structured and concise evidence context. By employing a two-stage learning framework that combines supervised trace learning with Trace-Guided Memory Policy Optimization (TMPO), MemChain effectively organizes memories based on their semantic roles and dependencies, significantly reducing context overhead. Experimental results on LoCoMo and LongMemEval-S show that MemChain not only achieves state-of-the-art performance but also improves answer quality while minimizing the memory context required for retrieval.
MemChain redefines memory management in LLMs, achieving state-of-the-art performance while slashing context overhead by transforming retrieved memories into a structured evidence context.
Memory-augmented LLM agents typically answer queries by retrieving relevant memories and feeding them directly to an answer model. This retrieval-as-evidence paradigm assumes retrieved memories are already suitable for reasoning, leaving the answer model to resolve redundancy, conflicts, and weak relevance while incurring substantial context overhead in long-term memory tasks. We propose MemChain, a trainable post-retrieval memory policy that transforms retrieved candidates into answer-facing active memory, represented as a compact and grounded evidence context. Given a user query and retrieved candidates, MemChain first generates a question-conditioned evidence plan, then constructs an ordered grounded evidence trace that organizes retrieved memories according to their semantic roles and dependencies, and finally executes explicit memory actions to produce a concise evidence context for answer generation. To train the mediator, we introduce a two-stage learning framework. Supervised trace learning first teaches the policy to generate structurally valid plans, traces, actions, and evidence contexts. We then propose Trace-Guided Memory Policy Optimization (TMPO), a reinforcement learning objective that optimizes the memory policy using downstream answer quality while jointly encouraging trace grounding, evidence support, structural validity, and answer stability across multiple rollouts. Experiments on LoCoMo and LongMemEval-S demonstrate that MemChain consistently achieves state-of-the-art performance across both closed-source and open-weight frozen answer models while substantially reducing the memory context passed to the answer model.
