Search papers, labs, and topics across Lattice.
This paper introduces the Magnitude-Direction Decoupling (MDD) method, which enhances video generation efficiency by leveraging lightweight models for denoising while maintaining fidelity through directional guidance. By separating the magnitude and direction components of the denoising process, MDD allows for significant acceleration in inference times鈥攗p to 2.95 times faster on the Wan2.1 dataset鈥攚ithout compromising visual quality. The findings highlight the potential for reducing computational overhead in flow matching models, making them more practical for real-time applications.
MDD achieves up to 2.95x faster video generation while preserving visual fidelity by decoupling magnitude and directional components in the denoising process.
Flow matching models for video generation achieve impressive performance but suffer from high computational overhead due to iterative denoising. In fact, the original model is not necessary for all denoising steps, allowing some steps to use lightweight alternatives for faster sampling. However, directly using caching or lightweight models can deviate from the original denoising trajectory, resulting in suboptimal performance. Through empirical analysis, we find that lightweight models can robustly capture the magnitude components of the original model's output, while caching provides reliable directional guidance. Building on this insight, we propose the Magnitude-Direction Decoupling (MDD) method, which adaptively employs a direction-calibrated lightweight model as a substitute for the original model to accelerate inference and effectively correct deviations in the denoising trajectory. Moreover, MDD further reduces inference costs by reusing magnitude information under classifier-free guidance (CFG). As a result, MDD offers a more reliable and lightweight solution to accelerate sampling. Experiments show that MDD outperforms existing acceleration methods, delivering promising speedups (e.g., up to 2.95x on Wan2.1) while preserving high visual fidelity and content richness.
