Search papers, labs, and topics across Lattice.
This paper introduces GRACE, a novel benchmark for assessing the faithfulness of reasoning in context-grounded tasks, addressing the limitations of existing methods that only evaluate final outputs. By providing a human-annotated, step-level evaluation framework with a data-driven error taxonomy, GRACE enables the identification of specific failures in reasoning processes across multiple models and datasets. The findings indicate that current models exhibit significant room for improvement, and incorporating step-level faithfulness signals into reinforcement learning enhances both accuracy and reasoning reliability.
GRACE reveals that existing models struggle with reasoning fidelity, exposing a critical gap in how we evaluate AI's contextual understanding.
Many reasoning tasks require models to reason over input context, from document-grounded question answering to rule-based deduction. Chain-of-Thought (CoT) prompting produces traces that appear transparent, yet individual steps can silently deviate from the source evidence, even when the final answer is correct. Existing methods detect hallucinations at the response level but fail to identify where in the chain a failure occurs or what type it is. We introduce GRACE, the first human-annotated step-level faithfulness benchmark with a data-driven error taxonomy for context-grounded textual reasoning. GRACE covers CoT traces from 10 models across 4 source datasets, with each step annotated for faithfulness, error category, and natural language explanation. A data-driven taxonomy, discovered bottom-up via unsupervised clustering, organizes failures into two tracks: GRACE-Inference (deductive errors) and GRACE-Grounding (factual grounding errors), with four categories each. The evaluation set is human-annotated and challenging by design. Our experiments reveal substantial headroom for current models. In addition, integrating step-level faithfulness signals into reinforcement learning pipelines improves both downstream accuracy and reasoning reliability.
