Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
RAGU is an innovative GraphRAG engine that enhances large language models by implementing a multi-step approach for knowledge graph construction, separating extraction from consolidation to mitigate noise and brittleness. By employing a compact extractor, Meno-Lite-0.1, optimized for language skills, RAGU achieves superior performance in knowledge-graph construction and matches larger models on GraphRAG tasks. The system demonstrates significant improvements in evidence recall and synthesis tasks, showcasing its effectiveness in multi-hop factoid question answering compared to existing methods like HippoRAG2.
A compact extractor can outperform larger models in knowledge-graph construction, achieving up to 84% evidence recall in GraphRAG tasks.
Graph retrieval-augmented generation (GraphRAG) enhances large language models with structured knowledge, yet existing systems construct knowledge graphs in a single extraction pass, producing noisy entities and brittle retrieval. RAGU, an open-source modular GraphRAG engine, addresses this by separating extraction from consolidation: entities and relations pass through two-stage typed extraction, DBSCAN-backed deduplication, LLM summarization, and Leiden community detection. A key insight motivates a compact extractor: the skills an in-pipeline LLM needs - comprehension, extraction, reasoning over context - are language skills that grow only weakly with model size, unlike factual world knowledge. Accordingly, we train Meno-Lite-0.1, a 7B model optimized for language skills, which outperforms Qwen2.5-32B on knowledge-graph construction (+12.5% relative harmonic mean) and matches it on English GraphRAG tasks. On GraphRAG-Bench (Medical), RAGU retrieves the most complete context at every factoid level (evidence recall up to 0.84 vs. $\leq$0.76) and overtakes HippoRAG2 on synthesis tasks; on multi-hop factoid QA, the apparent HippoRAG2 advantage is shown to be largely an answer-format artifact. RAGU is installable via $\texttt{pip install graph_ragu}$, runs on a single GPU, and is released under MIT. The source code is publicly available at https://github.com/RaguTeam/RAGU, and the Meno-Lite-0.1 model can be obtained from https://huggingface.co/bond005/meno-lite-0.1.