Search papers, labs, and topics across Lattice.
This paper introduces MemSearch-o1, an innovative framework that enhances large language models (LLMs) by implementing reasoning-aligned memory growth and retracing to address the memory dilution problem in agentic search. By dynamically generating fine-grained memory fragments from query seed tokens and reorganizing them into a globally connected memory path, the approach significantly improves the retention of relevant information and the activation of reasoning capabilities. Experimental results across eight benchmark datasets demonstrate that MemSearch-o1 effectively mitigates memory dilution and enhances the reasoning potential of various LLMs, paving the way for more sophisticated memory-aware agentic intelligence.
Memory dilution in LLMs is tackled head-on with a novel framework that not only preserves information but also amplifies reasoning capabilities.
Recent advances in large language models (LLMs) have scaled the potential for reasoning and agentic search, wherein models autonomously plan, retrieve, and reason over external knowledge to answer complex queries. However, the iterative think-search loop accumulates long system memories, leading to memory dilution problem. In addition, existing memory management methods struggle to capture fine-grained semantic relations between queries and documents and often lose substantial information. Therefore, we propose MemSearch-o1, an agentic search framework built on reasoning-aligned memory growth and retracing. MemSearch-o1 dynamically grows fine-grained memory fragments from memory seed tokens from the queries, then retraces and deeply refines the memory via a contribution function, and finally reorganizes a globally connected memory path. This shifts memory management from stream-like concatenation to structured, token-level growth with path-based reasoning. Experiments on eight benchmark datasets show that MemSearch-o1 substantially mitigates memory dilution, and more effectively activates the reasoning potential of diverse LLMs, establishing a solid foundation for memory-aware agentic intelligence.
