Search papers, labs, and topics across Lattice.
This paper introduces MemSIF, a novel memory framework designed to enhance long-term memory in LLM agents by addressing two critical misalignment issues: Temporal-Structural Misalignment (TSM) and Delayed Utility Manifestation (DUM). By organizing interactions into Topical Segments and Event Trajectories, and employing a Dual-Track Fact Memory system, MemSIF significantly improves memory accuracy across multiple LLMs. Experimental results demonstrate that MemSIF outperforms existing baselines, achieving up to an 8.79% increase in accuracy on benchmark tasks, thereby validating its effectiveness in long-horizon interactions.
MemSIF boosts LLM memory accuracy by up to 8.79% by tackling critical misalignment issues in long-term interactions.
Long-term memory is critical for LLM agents operating over long-horizon interactions. However, several persistent limitations of existing memory systems can be traced to two recurring misalignment patterns in long-term interaction settings: Temporal-Structural Misalignment (TSM) and Delayed Utility Manifestation (DUM). TSM arises when temporal proximity does not reliably align with topical or event-level relatedness, whereas DUM arises when write-time salience does not reliably predict future query utility. To mitigate these misalignment patterns, we propose MemSIF (Memory with Structured Interactions and Facts), a structured interaction-to-fact memory framework. Structured Interaction Memory organizes raw interactions into Topical Segments that preserve local topical coherence and Event Trajectories that maintain cross-time event continuity. Dual-Track Fact Memory uses two complementary tracks: CoreFact memory consolidates stable, schema-guided information at write time, whereas ActiveFact memory forms facts on demand and promotes those supported by multiple historical sources and recurring query demand for reuse. Experiments on LoCoMo and LongMemEval-S across five backbone LLMs show that MemSIF achieves the highest Total ACC in all settings, outperforming the strongest baseline by 2.29%-8.79% on LoCoMo and 2.87%-6.15% on LongMemEval-S. These results support the effectiveness of combining Structured Interaction Memory with Dual-Track Fact Memory to mitigate TSM and DUM. Code is available at https://github.com/luoyufeihaha/MemSIF.
