Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces G-Long, a graph-enhanced memory management framework designed to improve long-term consistency in dialogue agents by utilizing a fine-tuned small Language Model (sLM) for structured triplet extraction and associative retrieval. By implementing an attention-aware importance scoring mechanism that leverages cross-attention signals from a T5 summarizer, G-Long effectively identifies and retains salient memories while reducing operational costs. Experimental results show that G-Long achieves state-of-the-art performance, with notable improvements in response quality and memory retrieval recall, all while minimizing computational overhead.
G-Long slashes operational costs while boosting dialogue consistency, achieving up to 40.8% better memory retrieval recall.
While Large Language Models (LLMs) have advanced open-domain dialogue systems, maintaining long-term consistency remains a challenge due to inherent limitations in long-context reasoning and the inefficiency of processing extensive raw text. Existing approaches typically rely on either unstructured memory storage, which is prone to information loss, or computationally expensive LLMs that incur high latency. To address these limitations, we propose G-Long, a graph-enhanced framework that utilizes a fine-tuned small Language Model (sLM) for structured triplet extraction and associative retrieval, significantly reducing operational costs. Furthermore, we introduce the novel attention-aware importance scoring mechanism that leverages the intrinsic cross-attention signals of a T5 summarizer to identify salient memories. Extensive experiments across diverse benchmarks demonstrate that G-Long achieves state-of-the-art performance in both response generation and memory retrieval, yielding performance gains of up to 9.8% in response quality on MSC and 40.8% in retrieval recall on LME, while significantly minimizing computational overhead.