Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper addresses the problem of temporal degradation in autoregressive video diffusion models when generating videos longer than the training horizon. They identify spectral bias in 3D positional embeddings and a lack of dynamic priors as key causes of this failure. To mitigate these issues, they propose FLEX, a training-free inference-time framework that uses Frequency-aware RoPE Modulation, Antiphase Noise Sampling, and Inference-only Attention Sink to improve long-term video generation.
Autoregressive video models can now generate 4-minute videos without retraining, thanks to a clever inference-time hack that fixes positional embedding bias and injects dynamic priors.
Autoregressive video diffusion models have emerged as a scalable paradigm for long video generation. However, they often suffer from severe extrapolation failure, where rapid error accumulation leads to significant temporal degradation when extending beyond training horizons. We identify that this failure primarily stems from the \textit{spectral bias} of 3D positional embeddings and the lack of \textit{dynamic priors} in noise sampling. To address these issues, we propose \textbf{FLEX} (\textbf{F}requency-aware \textbf{L}ength \textbf{EX}tension), a training-free inference-time framework that bridges the gap between short-term training and long-term inference. FLEX introduces Frequency-aware RoPE Modulation to adaptively interpolate under-trained low-frequency components while extrapolating high-frequency ones to preserve multi-scale temporal discriminability. This is integrated with Antiphase Noise Sampling (ANS) to inject high-frequency dynamic priors and Inference-only Attention Sink to anchor global structure. Extensive evaluations on VBench demonstrate that FLEX significantly outperforms state-of-the-art models at $6\times$ extrapolation (30s duration) and matches the performance of long-video fine-tuned baselines at $12\times$ scale (60s duration). As a plug-and-play augmentation, FLEX seamlessly integrates into existing inference pipelines for horizon extension. It effectively pushes the generation limits of models such as LongLive, supporting consistent and dynamic video synthesis at a 4-minute scale. Project page is available at \href{https://ga-lee.github.io/FLEX_demo}{https://ga-lee.github.io/FLEX}.