Search papers, labs, and topics across Lattice.
This paper introduces a semi-supervised framework that enhances large language model (LLM) reasoning by utilizing a lightweight reasoning-correctness classifier trained on minimal labeled data. By transforming reasoning verification into a data creation mechanism and employing an entropy-based confidence threshold, the framework effectively filters out unreliable samples, allowing for fine-tuning with high-confidence reasoning traces. Experiments demonstrate that this approach achieves accuracy levels comparable to using 10-15 times more labeled data, showcasing its potential for scalable reasoning resource construction with reduced human input.
Achieving LLM reasoning accuracy on par with extensive labeled datasets using only minimal supervision could revolutionize how we approach data efficiency in AI training.
For the development of Large language models (LLMs), recent approaches to generating pseudo intermediate reasoning have shown remarkable progress. But they typically rely on large numbers of correctly annotated answers to assess reasoning quality. This paper presents a semi-supervised framework that scales reasoning learning from minimal supervision, turning reasoning verification itself into a data creation mechanism. We train a lightweight reasoning-correctness classifier on only a few labeled samples, which judges whether intermediate reasoning traces generated by an LLM are valid. Furthermore, an entropy-based confidence threshold filters out unreliable samples, and the remaining high-confidence reasoning traces are used to fine-tune the model. Experiments on Verifiable Math Problems (Orca-Math subset) and Question Answering on Image Scene Graphs (GQA) with Visual Programming show that our method achieves accuracy comparable to using 10-15x more labeled data. Ablation analyses confirm that both the classifier and entropy filtering are essential for scalable and noise-resistant pseudo-labeling. By replacing expensive answer-level supervision with lightweight reasoning verification, our method provides a practical path toward constructing large-scale reasoning resources and paves the way for future autonomous reasoning systems that learn from minimal human input.
