Search papers, labs, and topics across Lattice.
This paper introduces Diff-VF, a training-free framework that transforms existing short-video diffusion models into long-video generators without the need for model modification or fine-tuning. By employing Hybrid Noise Initialization, Weighted Window Sampling, and Temporal Extended Sampling, Diff-VF effectively maintains long-range temporal coherence and motion diversity in generated videos. Evaluation results indicate that Diff-VF outperforms both baseline models and recent training-free methods in achieving a superior balance between temporal coherence and motion diversity while retaining competitive frame-wise quality.
Achieving high-quality long video generation without any model retraining, Diff-VF redefines the capabilities of existing short-video diffusion frameworks.
Recently, diffusion models have made great progress in video generation. However, most existing video diffusion models are trained with short videos, and degrade when extrapolated to long videos, struggling to maintain long-range temporal coherence while retaining diverse motions. To generate consistent, high-quality and dynamic long videos, we propose Diff-VF, a training-free, plug-and-play and model-agnostic framework that converts existing short-video diffusion backbones into long-video generators without modifying or fine-tuning the base model. Diff-VF couples three complementary strategies: Hybrid Noise Initialization (HNI) to constrain global semantics, Weighted Window Sampling (WWS) to remove inter-window discontinuities, and Temporal Extended Sampling (TES) to establish long-range dependencies with a timestep-varying fusion. We further extend Diff-VF to long-video enhancement via Skip Residual Guidance that balances fidelity and realism through timestep-dependent guidance. VBench-Long evaluation results show that Diff-VF achieves a more favorable balance between temporal coherence and motion diversity than base models and recent training-free long video generation baselines, including FreeNoise, FreeLong, and RIFLEx, while maintaining competitive frame-wise quality. Experiments on two base models demonstrate the applicability to video diffusion models with different spatial-temporal modeling strategies. Extensive ablations validate the contribution of each component and hyperparameters.
