Search papers, labs, and topics across Lattice.
This paper introduces HyperMem, a hypergraph-based memory architecture for conversational agents that models high-order associations between topics, episodes, and facts using hyperedges. HyperMem employs a hierarchical memory structure and a hybrid lexical-semantic index with a coarse-to-fine retrieval strategy to unify scattered content into coherent units. Experiments on the LoCoMo benchmark demonstrate that HyperMem achieves state-of-the-art performance, achieving 92.73% LLM-as-a-judge accuracy, indicating its effectiveness in long-term conversation management.
Fragmented retrieval in long-term conversational agents is solved by HyperMem, which uses hypergraphs to model high-order associations between memories, achieving state-of-the-art performance.
Long-term memory is essential for conversational agents to maintain coherence, track persistent tasks, and provide personalized interactions across extended dialogues. However, existing approaches as Retrieval-Augmented Generation (RAG) and graph-based memory mostly rely on pairwise relations, which can hardly capture high-order associations, i.e., joint dependencies among multiple elements, causing fragmented retrieval. To this end, we propose HyperMem, a hypergraph-based hierarchical memory architecture that explicitly models such associations using hyperedges. Particularly, HyperMem structures memory into three levels: topics, episodes, and facts, and groups related episodes and their facts via hyperedges, unifying scattered content into coherent units. Leveraging this structure, we design a hybrid lexical-semantic index and a coarse-to-fine retrieval strategy, supporting accurate and efficient retrieval of high-order associations. Experiments on the LoCoMo benchmark show that HyperMem achieves state-of-the-art performance with 92.73% LLM-as-a-judge accuracy, demonstrating the effectiveness of HyperMem for long-term conversations.
