Search papers, labs, and topics across Lattice.
Framing temporal coherence as a state transport problem, this work introduces Spectral Tension, a signed diagnostic that contrasts local attention diffuseness against global spectral diversity to pinpoint temporal fragmentation and over-mixing hotspots in video diffusion models. Existing training-free approaches rely on coarse heuristics or indiscriminately boost cross-frame attention, failing to detect whether temporal dynamics remain in a mathematically stable transport regime. Leveraging this diagnostic, the authors design Spectral Transport Homeostasis, an inference-time regulator that selectively corrects pathological temporal states to improve video fidelity and attribute persistence without fine-tuning.
Temporal degradation in video diffusion isn't just caused by weak cross-frame attention鈥攊t is driven by an underlying spectral imbalance between local diffuseness and global diversity that can be selectively repaired at inference time without retraining.
Reliable video generation requires more than high-quality frames to form a coherent story: a model must maintain a persistent state, transporting visual attributes such as identity, scene layout, motion, and fine details across time. Existing training-free methods mainly strengthen cross-frame attention or analyze local attention entropy, but these views do not reveal whether temporal interactions stay in a healthy transport regime. In this work, we study video generation through the perspective of Temporal State Transport. We introduce Spectral Tension, a signed diagnostic that compares local attention diffuseness with global spectral diversity, and use it to identify two opposite temporal failures: fragmented transport and over-mixing hotspots. Based on this diagnosis, we propose Spectral Transport Homeostasis, a training-free regulator that softly corrects pathological temporal states while largely preserving balanced ones. Experiments on pretrained video generation models show that the original model often occupies imbalanced temporal regimes, whereas our method selectively applies larger corrections to the worst temporal hotspots and improves temporal consistency and visual quality without finetuning. Code: https://github.com/lytang63/temporal-state-transport
