Search papers, labs, and topics across Lattice.
This paper introduces Debate-on-Graph (DoG), a novel framework that enhances the reasoning capabilities of large language models (LLMs) by leveraging uncertain knowledge graphs (UKGs) to filter out noise and errors in question answering tasks. By employing a heuristic search algorithm to extract reliable subgraphs and a Multi-Agent Debate mechanism for adaptive reasoning, DoG significantly improves the reliability of answers generated by LLMs. Experimental results demonstrate that DoG achieves state-of-the-art performance across four benchmark QA datasets, addressing the critical issue of hallucinations in LLMs when interacting with knowledge graphs.
Uncertain knowledge graphs can transform LLM reasoning, reducing hallucinations and enhancing answer reliability through adaptive debates.
Large language models (LLMs) have demonstrated remarkable capabilities in natural language processing. However, LLMs often suffer from hallucinations and lack of relevant knowledge when dealing with question answering (QA) tasks. To mitigate these issues, knowledge graphs (KGs) have been utilized to enhance LLM reasoning. Nevertheless, KGs often contain noise and errors, while existing KG-enhanced LLM approaches are generally unable to identify and filter such noisy and erroneous content, which can instead amplify hallucinations and pose challenges for reliable reasoning. Uncertain knowledge graphs (UKGs), which associate each triple with a confidence score to quantify uncertainty, offer a promising direction to address this challenge. Compared with prior work, we investigate how to leverage UKGs to support LLMs for QA. We propose Debate-on-Graph (DoG), a new framework that enables LLMs and UKGs to collaborate adaptively for reliable reasoning. Specifically, we first design a heuristic search algorithm tailored for UKGs to extract reliable and question-relevant subgraphs, thereby reducing noise and errors in retrieved knowledge. We then introduce a Multi-Agent Debate mechanism, which yields reliable answers through adaptive adversarial debates, aiming to fully exploit the knowledge in UKGs while preserving the reliability of retrieved evidence. Extensive experiments on four benchmark QA datasets show that DoG achieves state-of-the-art performance over existing LLM reasoning methods and KG-based baselines, while enabling reliable and adaptive reasoning. Our code is available at https://github.com/seucoin/Debate-on-Graph.
