Search papers, labs, and topics across Lattice.
This paper addresses the degradation of autoregressive video diffusion models during long-horizon generation, specifically focusing on the trade-off between spatial stability and motion continuity in fixed-camera nature videos. The authors introduce Steady-Forcing, a comprehensive framework that integrates a persistent visual anchor, an exponential moving-average motion memory, and task-focused distillation from a large teacher model to enhance both background consistency and fluid dynamics over extended rollouts. Evaluations demonstrate that Steady-Forcing significantly improves visual quality and user-perceived stability compared to seven baseline models, highlighting the need for more nuanced benchmarks in static-camera video generation.
Long-horizon nature video generation can achieve unprecedented stability and motion continuity through a novel framework that balances visual persistence with dynamic fluid effects.
Autoregressive video diffusion models enable streaming generation but often degrade over long rollouts: static scene layouts drift, while mechanisms that improve spatial stability tend to suppress motion, causing natural flows such as water, fire, or smoke to stagnate. We study this stability-motion trade-off in fixed-camera long-horizon nature video generation, where the two failure modes can be more clearly separated than in moving-camera settings. We propose Steady-Forcing, a memory and training framework combining a persistent visual anchor (V-Sink), an exponential moving-average motion memory (EMA-Sink), block-relative temporal encoding, periodic cache purification, and distillation from a Wan2.1-14B teacher with motion-rewarded priors under task-focused configurations. Together, these components are designed to preserve background identity while sustaining visually plausible fluid dynamics over multi-minute autoregressive rollouts. Evaluations across seven baselines show that Steady-Forcing improves long horizon background consistency and imaging quality, while a blind user study indicates stronger perceived stability and motion continuity. The benchmark evaluation further suggest that generic VBench aggregate scores under-penalize fixed-camera artifacts as well as rewarding drift-induced optical flow as Dynamic Degree while not directly penalizing texture hardening or flow stagnation - motivating future task-specific benchmarks for static-camera nature-flow evaluation. Project page: https://minar09.github.io/steadyforcing/
