Search papers, labs, and topics across Lattice.
The paper introduces GeoFlow, a framework that enhances the efficiency of driving video generation by utilizing Geometry-Aligned Priors (GAP) instead of the conventional Gaussian noise initialization. This approach leverages multi-view geometry and spatially-adaptive noise injection to better capture the spatiotemporal correlations in driving videos, resulting in a more direct sampling trajectory. Experimental results show that GeoFlow significantly improves both training and inference efficiency, enabling high-quality video generation with fewer sampling steps and reduced computational demands.
By replacing standard Gaussian noise with Geometry-Aligned Priors, GeoFlow slashes inference steps while boosting video generation quality.
Generative models like Diffusion Models and Flow Matching have demonstrated remarkable capabilities in synthesizing high-fidelity driving videos, but are severely constrained by high inference latency due to the requirement of extensive sampling steps. We argue that this inefficiency stems from the prevailing reliance on a standard Gaussian source distribution, where consecutive frames are initialized as independent Gaussian noise. This paradigm disregards the rich spatiotemporal correlations inherent in driving videos, compelling the model to regenerate deterministic scene structures existing in previous frames from noise, which is both computationally redundant and prone to geometric inconsistency. To address this problem, we propose GeoFlow, a novel framework designed to achieve efficient driving video generation by harnessing explicit geometric priors. Instead of sampling from standard Gaussian noise, we leverage multi-view geometry and spatially-adaptive noise injection to construct a Geometry-Aligned Prior (GAP) distribution as starting point. This initialization bridges the gap between source distribution and data distribution, yielding a significantly straighter and shorter sampling trajectory. Extensive experiments demonstrate that GeoFlow can achieve remarkable efficiency of both training and inference: merely several hours of fine-tuning on baseline models can significantly boost few-step generation quality, while fully converged training drastically reduces number of inference steps required for state-of-the-art video generation.
