Search papers, labs, and topics across Lattice.
This paper introduces Self-Aware Scheduling (SAS), a method that optimizes the order of token unmasking in diffusion language models to enhance generation quality. By deriving a tractable upper bound on sequential decoding mismatch and framing order selection as a policy optimization problem, SAS significantly improves accuracy in tasks such as Sudoku and mathematical reasoning. The results show a marked increase in performance, with Sudoku accuracy rising from 82.0% to 91.8%, and substantial gains in pass rates on benchmark datasets like GSM8K and MBPP.
Optimizing the order of thought in diffusion models can boost accuracy by over 9% on complex tasks like Sudoku and mathematical reasoning.
Masked diffusion language models decode by iteratively unmasking tokens, where the unmasking order defines an "order of thought" that strongly influences generation quality yet is typically chosen heuristically. We derive a tractable upper bound on the sequential decoding mismatch, measured by the Kullback-Leibler divergence and expressed in terms of the model's pathwise log-likelihood, with tightness under sufficient model expressivity. This bound induces a dense self-aware reward over ordered trajectories, casting order selection as a principled policy optimization problem with a frozen denoiser. We instantiate this idea as Self-Aware Scheduling (SAS), which learns a lightweight order policy using Group Relative Policy Optimization and applies seamlessly to both any-order and semi-autoregressive decoding. On Sudoku with 1B MDM, SAS improves puzzle accuracy from 82.0% (best heuristic schedule) to 91.8%, and reaches 97.5% with second-stage fine-tuning along learned trajectories. On mathematical reasoning with LLaDA-8B, SAS improves pass@1 on GSM8K from 64% to 76% and on MBPP from 39.5% to 41%, consistently matching or exceeding heuristic schedules across generation lengths and block sizes. Project page: https://jimmyxu123.github.io/SAS
