Search papers, labs, and topics across Lattice.
This paper introduces Fully Unsupervised Score Ensembling (FUSE), a novel approach for enhancing the verification of model outputs without relying on labeled data. By controlling conditional dependencies among verifiers, FUSE leverages spectral algorithms to significantly improve unsupervised performance, often surpassing semi-supervised methods. The method was validated across a range of benchmarks, demonstrating its effectiveness in both conventional and challenging scenarios, thus highlighting its potential for real-world applications in LLM deployment.
FUSE achieves verification quality on par with semi-supervised methods, all without needing any labeled data.
Verification of model outputs is rapidly emerging as a key primitive for both training and real-world deployment of large language models (LLMs). In practice, this often involves using imperfect LLM judges and reward models since ground truth acquisition can be time-consuming and expensive. We introduce Fully Unsupervised Score Ensembling (FUSE), a method for improving verification quality by ensembling verifiers without access to ground truth correctness labels. The key idea behind FUSE is to control conditional dependencies between verifiers in a manner that improves the unsupervised performance of a class of spectral algorithms from the ensembling literature. Despite requiring zero ground truth labels, FUSE typically matches or improves upon semi-supervised alternatives in test-time scaling experiments with diverse sets of generator models, verifiers, and benchmarks. In particular, we validate our method on both conventional academic benchmarks such as GPQA Diamond and on frontier, unsaturated benchmarks such as Humanity's Last Exam and IMO Shortlist questions.
Google Research
Stanford HAI