Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The authors investigate why continuous diffusion models struggle with globally constrained discrete reasoning tasks, identifying that standard reverse-process updates prematurely anchor the model to early discrete errors. Without retraining, abandoning standard noisy updates to sample directly from the model's clean $\hat{x}_0$ predictions improves Sudoku validity from 31% to 95%, with similar improvements across Latin squares, graph connectivity, and N-queens. To fix the underlying train-test trajectory drift for standard samplers, they incorporate self-correction training that exposes the model to its own intermediate predictions, proving that continuous diffusion can master complex combinatorial constraints.
Continuous diffusion fails at discrete reasoning primarily because standard reverse samplers stubbornly anchor to early mistakes: simply jumping directly to clean predictions spikes Sudoku validity from 31% to 95% with zero retraining.
Denoising Diffusion Probabilistic Models (DDPMs) generate samples by starting from noise and repeatedly denoising while keeping each update close to the current noisy state. This behavior is effective in many continuous domains, but its role is less clear for globally constrained discrete tasks, such as Sudoku, graph connectivity, Latin squares, and N-queens. In such settings, early discrete errors can be difficult to undo. As a result, standard diffusion sampling may preserve early mistakes, even when the model's clean predictions are informative. We compare standard samplers to sampling directly from the model's clean prediction. Without retraining, this single change improves Sudoku validity from 31% to 95%, with consistent gains across the other discrete tasks. We hypothesize that staying close to the current noisy state is harmful because the reverse trajectory can drift off the forward noising distribution the model was trained on. To reduce this train-test mismatch, we further introduce self-correction training, which exposes the model to its own predictions, improving robustness to errors that arise during inference. This substantially improves the performance of standard samplers. Our results suggest that continuous diffusion models can learn nontrivial global constraints, but discrete reasoning tasks require better alignment between training and inference: either through samplers that reduce commitment to early decisions, or through training that teaches the model to correct its own inference-time errors.