Search papers, labs, and topics across Lattice.
This paper introduces FreqForcing, a training-free framework for long video generation that addresses error accumulation in autoregressive video diffusion models. By analyzing error propagation in the frequency domain, the authors develop Spectral Self-Anchoring (SSA) to stabilize low-frequency components while maintaining high-frequency motion dynamics. The results demonstrate that FreqForcing achieves 24x extrapolation and significantly outperforms existing training-free methods in both quantitative and qualitative assessments, while remaining competitive with training-based approaches.
Error accumulation in long video generation can be mitigated with a novel frequency-domain approach, achieving 24x extrapolation without the need for extensive training.
Autoregressive video diffusion models enable real-time streaming video generation. However, errors introduced during self-rollout accumulate over long horizons, manifesting as color drift, motion stagnation, and eventual visual collapse. In this paper, we characterize this phenomenon from a frequency-domain perspective: error accumulation appears as a pronounced energy drift in the low-frequency bands. We further investigate the effectiveness of attention sink in the frequency domain, and find that it improves the video quality by alleviating the spectral energy drift to some extent, but cannot fully resolve it. Motivated by the above analysis, we propose FreqForcing, a training-free framework that addresses error accumulation in long-video generation via Spectral Self-Anchoring (SSA). The proposed SSA leverages the low-frequency components of anchor attention to maintain long-horizon visual stability, while preserving dynamic motion through the high-frequency components of local attention. Our FreqForcing extends Self-Forcing pretrained on 5s clips to two-minute generation, achieving 24x extrapolation. Extensive experiments show that FreqForcing outperforms existing training-free methods quantitatively and qualitatively while remaining competitive with representative training-based approaches.
CMU ML