Search papers, labs, and topics across Lattice.
This paper introduces a reinforcement learning (RL) framework using Group Relative Policy Optimization (GRPO) to jointly optimize sentence decomposition and verifier alignment for complex claim verification. The method incorporates structured sequential reasoning, supervised finetuning on teacher-distilled exemplars, and a multi-objective reward function balancing format compliance, verifier alignment, and decomposition quality. Results show the 8B-parameter model achieves state-of-the-art verification performance (71.75% macro-F1), surpassing prompt-based and existing RL methods, while generating high-quality subclaims as confirmed by human evaluation.
Smaller language models can now achieve state-of-the-art claim verification performance by jointly optimizing for decomposition quality and verification accuracy using a novel reinforcement learning approach.
Complex claim verification requires decomposing sentences into verifiable subclaims, yet existing methods struggle to align decomposition quality with verification performance. We propose a reinforcement learning (RL) approach that jointly optimizes decomposition quality and verifier alignment using Group Relative Policy Optimization (GRPO). Our method integrates: (i) structured sequential reasoning; (ii) supervised finetuning on teacher-distilled exemplars; and (iii) a multi-objective reward balancing format compliance, verifier alignment, and decomposition quality. Across six evaluation settings, our trained 8B decomposer improves downstream verification performance to (71.75%) macro-F1, outperforming prompt-based approaches ((+1.99), (+6.24)) and existing RL methods ((+5.84)). Human evaluation confirms the high quality of the generated subclaims. Our framework enables smaller language models to achieve state-of-the-art claim verification by jointly optimising for verification accuracy and decomposition quality.
