Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
Distribution Matching Distillation (DMD) enables few-step video generation but suffers from progressive oversaturation and artifact degradation caused by error accumulation in the critic network. To solve this, Projected DMD (PDMD) algebraically projects out the student update component parallel to the student-critic endpoint residual, which is proven to be an unbiased estimate of critic error that eliminates noise while preserving true distillation signal in high dimensions. Implemented as a single-line code change with zero added computational overhead, PDMD establishes new 4-NFE state-of-the-art results on Wan2.1 (83.73 VBench) and MiniMax-H3 joint video-audio generation.
Severe oversaturation and artifacts in few-step video distillation stem directly from compounding critic errors, which can be neutralized via a single-line geometric projection without discarding the true generative signal.
Modern video diffusion models require tens of denoising evaluations over long spatiotemporal token sequences. Distribution Matching Distillation (DMD) reduces the number of function evaluations (NFE) to just a few. However, DMD samples can degrade during training, exhibiting progressive oversaturation and artifacts. We trace this instability to critic errors, which enter successive student updates and accumulate over time. We introduce Projected Distribution Matching Distillation (PDMD) to filter critic errors. PDMD projects out the component of the DMD update parallel to the student-critic endpoint residual. At a fixed noisy query, we prove that this residual is an unbiased estimate of the critic's endpoint error. Under high-dimensional assumptions, this projection removes a constant fraction of critic error while discarding only a vanishing fraction of ideal DMD signal. Empirically, the projection stabilizes training and improves sample quality where DMD degrades and develops unnatural textures. PDMD requires only a one-line code change to DMD, with no extra loss, network, data, model pass, or multi-stage training. With Wan2.1, PDMD achieves a VBench total score of 83.73 at 4 NFE, surpassing matched DMD by 1.03 points. On MiniMax-H3 joint video-audio generation, PDMD achieves a VideoGen-Eval visual total score of 83.17, 0.41 points above the strongest distilled baseline. PDMD also achieves the best performance on all six audio metrics among the compared 4-NFE models. Qualitative comparisons and user studies favor PDMD over the distilled baselines in visual quality, motion, and audio quality. Code and models are available at https://pdmd2026.github.io/.