Search papers, labs, and topics across Lattice.
FABSVer fuses solution generation and verification into a single pass, significantly reducing training time for mathematical reasoning in LLMs. To address reward plateaus during training, they introduce Dynamic Reference Model Update (DRMU), which adaptively adjusts the reference model to enable continued learning. Experiments show FABSVer outperforms existing methods in both self-verification and reasoning accuracy, while also reducing training time by up to 49%.
Training LLMs to verify their own math proofs is now twice as fast, thanks to a clever fusion of generation and verification into a single training pass.
While large language models have made significant progress in mathematical reasoning, they remain unreliable at judging the correctness of their own solutions. Existing approaches that equip models with self-verification typically treat solution generation and verification as two separate tasks, leading to substantially increased training time. In this paper, we propose FABSVer, which fuses these two tasks into a single generation pass, dramatically reducing training overhead while jointly optimizing both capabilities. We further identify a convergence bottleneck both theoretically and empirically: as training progresses, the reward reaches a plateau because the policy is constrained by a fixed reference model. To overcome this, we introduce Dynamic Reference Model Update (DRMU), which raises the reward ceiling and enables sustained reward growth. Extensive experiments on math benchmarks demonstrate that FABSVer achieves superior self-verification and reasoning performance across three model scales, while requiring only 51%--71% of the training time of existing methods. Analysis further reveals distinct learning phases in how models acquire self-verification, and that the gap between verify and answer rewards shrinks noticeably as model size increases.
