Search papers, labs, and topics across Lattice.
This paper investigates the limitations of image-to-video diffusion models in maintaining physical consistency during motion generation, revealing that a 2-step generation process can outperform a 50-step output in this regard. The authors attribute this phenomenon to significant phase erosion during the denoising process, which they quantify through spectral analysis. To address this issue, they introduce PhaseLock, a framework that preserves motion priors from initial steps, resulting in improved physical consistency without sacrificing visual fidelity or incurring substantial computational costs.
A 2-step generation can yield better physical consistency than a lengthy 50-step process, challenging assumptions about model depth in video synthesis.
Image-to-Video diffusion models leverage input images to generate visually stunning content, yet frequently produce motion that violates physical laws. We reveal a surprising finding: a 2-step generation often exhibits better physical consistency than a 50-step output from the same model. Through spectral analysis, we trace this to phase erosion during denoising; the phase degrades significantly (dropping by $\approx 18\%$ from step 2 to step 50), whereas the magnitude remains relatively stable. Building on this insight, we propose PhaseLock, a training-free framework that preserves the valid motion priors from few-step inference throughout the denoising trajectory. Rather than relying on full-step inference for physical consistency, PhaseLock extracts a motion prior from just 2 steps and enforces it onto high-fidelity generation via Latent Delta Guidance. Our approach effectively mitigates phase degradation, improving physical consistency by an average of 6.2 points across diverse models while largely maintaining visual fidelity, with negligible overhead ($1.06\times$ time, $1.02\times$ memory) and reduced reliance on expensive external guidance methods ($\sim5\times$ time).
