Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces the Long Chain-of-Thought Graph Verifier (LCoT-GV), a novel graph-based framework that models Long Chains-of-Thought (LCoTs) as reasoning graphs to enhance the verification of reasoning steps in large language models. By employing a Graph Attention Network, the authors train the model to assess the correctness of reasoning chains, addressing issues of contradictions and unsupported inferences that can arise even when final answers are accurate. The proposed method demonstrates competitive performance against existing verification approaches on a newly constructed graph-oriented dataset derived from various reasoning benchmarks.
LCoT-GV reveals that even correct answers can be underpinned by flawed reasoning, and offers a robust method for verifying the integrity of these reasoning chains.
Large Reasoning Models produce Long Chains-of-Thought (LCoTs) which involve breaking down the problem into smaller reasoning steps before reaching the conclusion. However, these steps often contain contradictions, unsupported inferences, or irrelevant steps, even when the final answer is correct. We propose Long Chain-of-Thought Graph Verifier (LCoT-GV), a graph-based framework that represents LCoTs as reasoning graphs. Each node in the graph represents a reasoning step and the edges encode semantic and logical relations. A Graph Attention Network is then trained to predict chain-of-thought correctness from the reasoning graph. We construct a new graph-oriented verification dataset from multiple reasoning benchmarks for question answering in various domains. The results show that our method is competitive with the most similar approaches.