Search papers, labs, and topics across Lattice.
The paper introduces GroundedKG-RAG, a retrieval-augmented generation system for long-document question answering that constructs a knowledge graph directly from the source document using semantic role labeling (SRL) and abstract meaning representation (AMR) parses. This approach grounds nodes (entities and actions) and edges (temporal/semantic relations) in the original sentences, enabling more accurate and efficient retrieval. Experiments on NarrativeQA show GroundedKG-RAG performs comparably to a proprietary long-context model at a lower cost and outperforms a competitive baseline, while also offering improved interpretability.
By explicitly grounding a knowledge graph within source documents, GroundedKG-RAG slashes resource consumption and hallucinations in long-document QA, achieving performance on par with proprietary models at a fraction of the cost.
Retrieval-augmented generation (RAG) systems have been widely adopted in contemporary large language models (LLMs) due to their ability to improve generation quality while reducing the required input context length. In this work, we focus on RAG systems for long-document question answering. Current approaches suffer from a heavy reliance on LLM descriptions resulting in high resource consumption and latency, repetitive content across hierarchical levels, and hallucinations due to no or limited grounding in the source text. To improve both efficiency and factual accuracy through grounding, we propose GroundedKG-RAG, a RAG system in which the knowledge graph is explicitly extracted from and grounded in the source document. Specifically, we define nodes in GroundedKG as entities and actions, and edges as temporal or semantic relations, with each node and edge grounded in the original sentences. We construct GroundedKG from semantic role labeling (SRL) and abstract meaning representation (AMR) parses and then embed it for retrieval. During querying, we apply the same transformation to the query and retrieve the most relevant sentences from the grounded source text for question answering. We evaluate GroundedKG-RAG on examples from the NarrativeQA dataset and find that it performs on par with a state-of-the art proprietary long-context model at smaller cost and outperforms a competitive baseline. Additionally, our GroundedKG is interpretable and readable by humans, facilitating auditing of results and error analysis.
