Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a graph-based retrieval-augmented generation (RAG) system designed to mitigate hallucinations in large language models (LLMs) during complex question answering. By employing a lightweight graph structure and a dedicated toolset for vector search and graph queries, the authors demonstrate significant improvements in precision and recall of factual correctness, halving the number of hallucinated responses. The system achieves the highest fine-grained truthfulness score on the MoNaCo benchmark, indicating a promising approach to enhancing the reliability of LLM outputs with minimal additional token usage.
Halving hallucinations in LLMs while boosting factual accuracy could redefine the reliability of AI in complex question answering tasks.
Large language models (LLMs) have fundamentally transformed the landscape of Natural Language Processing. Despite these advances, LLMs and LLM-based systems remain prone to a variety of failure modes. Retrieval-augmented generation (RAG) systems have emerged as a common deployment scenario seeking to both avoid the well known risk of the LLM "hallucinating" information, and to enable reasoning and question answering over proprietary information that the LLM did not have access to during training without resorting to expensive model fine-tuning. In this work, we explore the idea of using a lightweight graph structure with a relatively simple graph schema, to support the RAG subsystem via a dedicated toolset. We design an agentic system with a variety of vector search and graph query tools operating over a structured dataset based on a curated subset of English Wikipedia articles, and evaluate its performance on questions from MoNaCo, a challenging Wikipedia QA benchmark of complex query answering tasks. Our results show that the introduction of graph-based tools can significantly increase the precision and recall of factual correctness, can halve the number of hallucinated answers, and achieves the highest fine-grained truthfulness score among the three evaluated scenarios. All this with a modest increase in token usage.