Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a post-training technique for diffusion language models (DLMs) that leverages Maximum Mean Discrepancy (MMD) in the feature space of a frozen pretrained DLM to align generated and reference distributions. By extracting contextual features at token positions, the method efficiently estimates MMD and optimizes the objective using policy gradients or direct differentiation, avoiding full trajectory sampling or auxiliary models. Empirical results demonstrate improved generative perplexity and accuracy-computation trade-offs on benchmark datasets, including enhanced decoding parallelism for large DLMs.
Aligning DLM generation with reference distributions via feature-space MMD significantly boosts performance on perplexity and reasoning tasks without retraining the entire model.
We introduce a post-training method for diffusion language models (DLMs) that minimizes Maximum Mean Discrepancy (MMD) between generated and reference distributions in the feature space of a frozen pretrained DLM. To estimate MMD, we retain contextual features at individual token positions, obtaining multiple observations per sequence from a single extractor pass. We optimize this objective using policy gradients for discrete models and direct differentiation through generated latents for continuous models. In both cases, computing the loss directly from these features enables efficient post-training without full sampling trajectories or jointly trained auxiliary models. Experiments show lower generative perplexity at comparable entropy on OpenWebText and better accuracy-computation trade-offs on GSM8K. On 16B DMax-LLaDA2.0 models with hybrid masked-uniform diffusion, we increase decoding parallelism with similar or higher accuracy on math and code benchmarks.