Search papers, labs, and topics across Lattice.
This paper introduces QUMem, a structured memory framework designed to enhance personalized user-state inference in LLM agents by addressing limitations in existing memory systems. By segmenting interaction histories into variable-length episodes and decomposing them into independently retrievable memory types, QUMem allows for more nuanced retrieval that respects temporal and contextual relevance. The framework achieves state-of-the-art performance on benchmark datasets, showcasing its effectiveness in enabling long-term personalization in LLM interactions.
QUMem revolutionizes user-state inference by enabling LLMs to retrieve contextually relevant memories that evolve over time, outperforming existing methods on key benchmarks.
Large language model (LLM) agents increasingly use external memory systems to support personalization by drawing on long and evolving interaction histories, in which user preferences may be distributed across time, change with context, and conflict with earlier evidence. However, existing systems face three limitations: fixed-turn, fixed-token, or session-based boundaries can mix unrelated dialogue or split an event from its causes, decisions, and outcomes; storing multiple pieces of user information from the same interaction as a single memory binds together items that serve different functions and should be independently retrievable; and treating the current task as a single top-$k$ retrieval query can return fragments that are individually relevant but fail to jointly capture preference evolution, temporal validity, and contextual applicability. We introduce \textsc{QUMem}, a structured memory framework for query-conditioned user-state inference. \textsc{QUMem} first segments interaction histories into variable-length episodes according to semantic continuity, then decomposes each episode into independently retrievable factual, preference, and transferable insight memories while preserving temporal positions and source evidence. At inference time, three sequential agents identify task-specific information needs, plan multi-query retrieval over the typed memory stores, and jointly infer a temporally and contextually valid user state for downstream response generation. \textsc{QUMem} achieves state-of-the-art performance on both PersonaMem and KnowU-Bench, demonstrating the effectiveness of query-conditioned user-state inference for long-term personalization.
