Search papers, labs, and topics across Lattice.
This paper analyzes the prevalence of Context-Sensitive Factual Hallucinations in large language models (LLMs) during long, multi-step reasoning tasks, revealing that these errors occur even when the model possesses the relevant knowledge. To mitigate this issue, the authors introduce Step-level Self-Consistency Group Relative Policy Optimization (SSC-GRPO), which assigns rewards based on the self-consistency of reasoning steps across multiple rollouts. SSC-GRPO outperforms existing methods on mathematical reasoning benchmarks and hallucination leaderboards, providing a novel approach to enhance the reliability of LLMs in complex reasoning scenarios.
Context-sensitive hallucinations in LLMs can be mitigated by a new optimization technique that rewards step-level consistency, leading to significant improvements in reasoning accuracy.
With the rapid advancement of large language models (LLMs), modern systems not only possess strong foundational capabilities and extensive knowledge, but can also solve complex problems via long, multi-step reasoning. However, as reasoning traces become longer, LLMs may produce a substantial amount of hallucinated content during the reasoning process, which is often difficult to detect. In this work, we conduct a fine-grained analysis of hallucinations arising in LLM reasoning and find that the reasoning traces are particularly prone to Context-Sensitive Factual Hallucinations: cases where the model actually has the relevant knowledge, yet makes factual errors due to contextual interference during reasoning. To address this issue, we propose Step-level Self-Consistency Group Relative Policy Optimization (SSC-GRPO), which assigns step-level rewards to reasoning traces by computing self-consistency scores of individual steps across multiple rollouts. Compared with prior methods, SSC-GRPO achieves state-of-the-art performance on both mathematical reasoning benchmarks and hallucination leaderboards. Our results offer a new perspective for detecting and mitigating hallucinations in the reasoning process of large language models.
