Search papers, labs, and topics across Lattice.
This paper introduces MemRefine, an LLM-guided framework designed to manage memory in long-term agent interactions by maintaining a fixed storage budget while optimizing the retention of useful information. The approach addresses the challenge of redundant memory entries that inflate storage costs and hinder retrieval efficiency, particularly in resource-constrained environments. Experimental results demonstrate that MemRefine not only adheres to memory budgets but also enhances performance compared to traditional rule-based methods across various benchmarks.
MemRefine outperforms rule-based memory management by leveraging LLMs to make nuanced decisions about which information to retain, delete, or merge, ensuring optimal memory usage without sacrificing performance.
Large language model (LLM) agents are increasingly expected to operate over long-term interactions, where information from past dialogues must be preserved and recalled to support future tasks. However, as interactions accumulate, the memory store grows without bound and fills with redundant entries that inflate storage cost and degrade retrieval by crowding out the most useful evidence. Furthermore, this is especially limiting on resource-constrained platforms with hard memory budgets, motivating us to formulate storage-budgeted memory management, the task of keeping an already constructed memory store within a fixed budget while preserving information useful for future interactions. To this end, we then propose MemRefine, an LLM-guided framework that, since surface similarity poorly reflects factual value, uses similarity only to propose candidate pairs and defers delete, merge, and preserve decisions to an LLM judge based on factual content, iterating until the budget is met. Across multiple memory frameworks and long-term conversation benchmarks, MemRefine consistently meets target budgets while preserving downstream performance and outperforming rule-based baselines under tight budgets.
