Search papers, labs, and topics across Lattice.
This paper introduces Pyligent, a novel training framework that enhances reasoning by allowing models to engage in validated search over partial solution chains, enabling them to backtrack upon encountering failures. By employing a task validator to label generated continuations and failures, Pyligent creates supervised targets for three actions: continue, finish, and backtrack, which significantly improves the model's ability to recover from errors. Evaluations show that Pyligent achieves substantial improvements in solve rates across various structured reasoning tasks, indicating that incorporating explicit supervision for failed branches can enhance recovery behaviors beyond mere imitation of successful solutions.
Explicit supervision of failed reasoning branches boosts model recovery rates, leading to a dramatic 72.7 percentage point improvement in solving hidden graph tasks.
Many reasoning tasks are not well described by a single left-to-right chain: a solver may need to pursue a plausible branch, observe delayed failure, and return to the latest prefix that can still be completed. We introduce Pyligent, a training and inference framework inspired by the Diligent Learner formulation that represents reasoning as validated search over partial solution chains. A task validator labels generated continuations and failures, and the resulting search trees are converted into supervised targets for three actions: continue, finish, and backtrack, with optional traces that summarize abandoned branches. We evaluate Pyligent on a hidden directed graph task designed to isolate delayed-failure recovery, and on structured reasoning domains with exact validators, including $4{\times}4$ Sudoku, Sudoku with reasoning traces, and Blocksworld. Compared with gold-only supervised fine-tuning, Pyligent improves solve rate by $72.7$ percentage points on hidden graphs, by $17$ and $18$ points on mixed and expert Sudoku, by $27$ and $14$ points on mixed and expert Sudoku with reasoning traces, and by $13$ points on Blocksworld. These results suggest that explicit failed-branch supervision can teach useful recovery behavior beyond imitation of polished solution chains.
