Search papers, labs, and topics across Lattice.
This paper introduces NGM-RAG, a novel framework that enhances Retrieval-Augmented Generation (RAG) by integrating graph structures to improve the retrieval and generation of answers for complex multi-hop questions. By employing a neural graph matching approach that combines text-based matching with Graph Neural Networks (GNNs), NGM-RAG effectively captures relational knowledge and utilizes an adaptive weighting strategy to optimize the selection of relevant contextual information. Experimental results show that NGM-RAG outperforms traditional RAG methods and other graph-enhanced approaches in multi-hop question answering and long-context summarization tasks.
NGM-RAG achieves superior performance in multi-hop reasoning by leveraging graph structures, outperforming traditional RAG methods and state-of-the-art graph-enhanced models.
Retrieval-Augmented Generation (RAG) significantly enhances the ability of Large Language Models (LLMs) to provide accurate and contextually relevant answers by dynamically integrating external databases. However, traditional RAG methods are primarily constrained by their reliance on text-based retrieval strategies, which often struggle with complex questions requiring multi-hop reasoning. To address this limitation, we introduce Neural Graph Matching based Retrieval-Augmented Generation (NGM-RAG), a novel framework that leverages graph structures to effectively capture and utilize relational knowledge for improved retrieval and answer generation. NGM-RAG explicitly incorporates graph construction, graph matching, and answer generation into a unified process. Within this framework, we propose a neural graph matching approach that combines text-based matching with Graph Neural Networks (GNNs). By employing an adaptive weighting strategy, NGM-RAG efficiently integrates multiple matching methods to select the most relevant contextual node information for answer generation. Experimental results on multi-hop question answering and long-context summarization tasks demonstrate that our NGM-RAG model achieves superior performance compared to both traditional NaiveRAG methods and state-of-the-art graph-enhanced approaches such as GraphRAG and LightRAG.
