Search papers, labs, and topics across Lattice.
The paper introduces OPSD-V, an on-policy self-distillation method designed to enhance few-step autoregressive video diffusion models by mitigating error accumulation and improving motion dynamics during long video rollouts. By incorporating real long-video data as temporal context during training, OPSD-V provides dense trajectory-level supervision that guides the student model in generating video chunks while maintaining the integrity of the inference path. Experimental results demonstrate significant improvements in visual quality and motion coherence, with user studies indicating a strong preference for OPSD-V over baseline models.
OPSD-V enhances video generation by leveraging real video data for on-policy self-distillation, leading to superior visual quality and motion dynamics.
We propose OPSD-V, an on-policy self-distillation paradigm for post-training few-step autoregressive (AR) video diffusion models. Existing few-step AR video generators can produce long videos with low latency, but still suffer from error accumulation and weakened motion dynamics during long autoregressive rollout. OPSD-V reduces long-horizon degradation while preserving the original few-step inference path. The key idea is to introduce real long-video data as temporal context during training and use it to provide dense trajectory-level supervision. Specifically, the student follows the exact inference-time rollout, generating each chunk conditioned on its own previously generated KV cache. In parallel, the teacher is evaluated at the same student-visited denoising states, but uses a cleaner AR-consistent temporal cache in which older history can be replaced by real-video context. This provides dense denoising-level corrective targets under on-policy AR cache dynamics, without changing the sampler, number of denoising steps, or inference-time cache mechanism. We apply OPSD-V to representative few-step AR video models, including Self-Forcing and LongLive. Experiments show consistent improvements in visual quality, motion dynamics, and VBenchLong scores. A user study with 10 participants comparing 20 video pairs shows that OPSD-V is preferred over the base models in 66.0% of overall-preference judgments (82.5% excluding ties).
