Search papers, labs, and topics across Lattice.
This paper introduces TIGRAG, a novel Retrieval-Augmented Generation framework that utilizes a token co-occurrence Knowledge Graph to enhance multi-hop reasoning in Large Language Models. By modeling token relationships through sliding-window co-occurrence statistics, TIGRAG enables efficient graph construction and retrieval, significantly improving upon traditional LLM-based extraction methods. Experimental results show that TIGRAG outperforms existing dense retrieval and graph-based RAG approaches across multiple QA benchmarks, while also reducing indexing time and inference latency.
TIGRAG achieves superior multi-hop reasoning in LLMs by leveraging a token co-occurrence graph, cutting down both computational costs and hallucinations.
Retrieval-Augmented Generation (RAG) mitigates hallucinations in Large Language Models (LLMs) by grounding the generation process on external knowledge. However, standard RAG approaches struggle with multi-hop reasoning. While recent graph-based RAG methods improve the retrieval of interconnected chunks, they often rely on computationally expensive and error-prone LLM-based extraction pipelines. To address these issues, we propose TIGRAG (Token-Induced GraphRAG), an efficient graph-augmented RAG framework based on a token co-occurrence Knowledge Graph. TIGRAG directly models topological relationships between tokens using sliding-window co-occurrence statistics, thus enabling scalable graph construction. During inference, it combines graph-based semantic expansion and neural reranking to retrieve interconnected evidence for multi-hop reasoning. Specifically, it introduces an iterative entity-driven retrieval strategy that progressively expands the query using bridging entities extracted from previously retrieved contexts. We evaluated TIGRAG on three widely adopted multi-hop Question Answering (QA) benchmarks. Experimental results demonstrated that our framework consistently outperforms dense retrieval and graph-based RAG methods in both retrieval and downstream QA tasks, while substantially reducing indexing time, inference latency, and prompt footprint.
