Search papers, labs, and topics across Lattice.
This paper introduces a novel GraphRAG approach that replaces Leiden clustering with k-core decomposition for constructing hierarchical document communities. The authors prove that Leiden clustering is non-reproducible on sparse knowledge graphs and demonstrate that k-core decomposition provides a deterministic, density-aware hierarchy in linear time. Experiments on real-world datasets show that the k-core-based GraphRAG improves answer comprehensiveness and diversity while reducing token usage compared to existing methods.
Ditch Leiden clustering for GraphRAG: k-core decomposition offers a deterministic, faster, and more effective way to build knowledge graph hierarchies for better LLM reasoning.
Retrieval-Augmented Generation (RAG) enhances large language models by incorporating external knowledge. However, existing vector-based methods often fail on global sensemaking tasks that require reasoning across many documents. GraphRAG addresses this by organizing documents into a knowledge graph with hierarchical communities that can be recursively summarized. Current GraphRAG approaches rely on Leiden clustering for community detection, but we prove that on sparse knowledge graphs, where average degree is constant and most nodes have low degree, modularity optimization admits exponentially many near-optimal partitions, making Leiden-based communities inherently non-reproducible. To address this, we propose replacing Leiden with k-core decomposition, which yields a deterministic, density-aware hierarchy in linear time. We introduce a set of lightweight heuristics that leverage the k-core hierarchy to construct size-bounded, connectivity-preserving communities for retrieval and summarization, along with a token-budget-aware sampling strategy that reduces LLM costs. We evaluate our methods on real-world datasets including financial earnings transcripts, news articles, and podcasts, using three LLMs for answer generation and five independent LLM judges for head-to-head evaluation. Across datasets and models, our approach consistently improves answer comprehensiveness and diversity while reducing token usage, demonstrating that k-core-based GraphRAG is an effective and efficient framework for global sensemaking.
