Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
Elastic Forcing eliminates the need for bidirectional diffusion teachers and online fake-score models in few-step autoregressive video generation by directly matching rollout distributions to reference videos. Using a hybrid Nyström–Monte Carlo estimator to minimize Maximum Mean Discrepancy (MMD) in frozen self-supervised feature spaces, the method dramatically cuts post-training memory overhead to enable 14B-parameter training on just eight H200 GPUs. At 1.3B parameters, it improves upon Self-Forcing by boosting VBench Total from 83.80 to 84.64 at 17 FPS while enabling style and concept acquisition without target-specific teachers.
Diffusion teachers and online score networks are no longer bottlenecks for distilling autoregressive video models: directly minimizing sample MMD against reference videos improves VBench scores while unlocking 14B post-training on just eight H200 GPUs.
Few-step autoregressive video generation commonly relies on Distribution Matching Distillation (DMD), requiring a bidirectional diffusion teacher and an online fake-score model. We instead learn the rollout distribution directly from reference videos, eliminating both score models during post-training. Our framework minimizes maximum mean discrepancy (MMD) in frozen self-supervised video representation spaces, using a hybrid Nyström--Monte Carlo estimator to balance approximation bias and sampling variance. Memory-efficient replay and gradient subsampling make this objective practical. Using the same architecture and initialization as Self-Forcing, our 1.3B model improves the VBench Total score from 83.80 to 84.64 while retaining 17 FPS. Removing auxiliary score models also enables 14B post-training on eight H200 GPUs. Beyond distillation, learning from reference videos enables the acquisition of new visual styles, semantic concepts, and spatial priors without a target-specific diffusion teacher.
Tsinghua AI