Search papers, labs, and topics across Lattice.
The paper introduces PACR-Video, a novel framework for parameter-efficient long video extrapolation that leverages low-rank temporal adapters and a recursive prompt bank to maintain coherence across multiple shots without the need for full generator fine-tuning. By conditioning these adapters on learned shot-role prompt tokens, the method effectively preserves recurring entities and scene structures while ensuring causal progression. Experimental results across six benchmarks demonstrate that PACR-Video significantly outperforms existing methods in various quality metrics, highlighting its effectiveness in achieving stable long video generation.
Compact prompt routing and lightweight temporal adaptation enable superior long video extrapolation without the overhead of full model fine-tuning.
We present PACR-Video, a parameter-efficient framework for multi-shot long video extrapolation that preserves recurring entities, scene structure, visual style, and causal progression without full generator fine-tuning. PACR-Video keeps a text-to-video diffusion transformer frozen and augments it with low-rank temporal adapters conditioned by learned shot-role prompt tokens. To maintain long-horizon coherence, it builds a recursive prompt bank that stores compact entity, location, action, and style prompts from previous shots, then routes them through adapter gates according to predicted narrative dependencies. A Shot-Local/Story-Global tuning objective combines next-shot reconstruction, cross-shot identity contrast, and prompt sparsity regularization, while an adapter composition schedule balances early-shot visual consistency with later-shot event progression and viewpoint change. Across six multi-shot and long-video benchmarks, PACR-Video outperforms text-to-video, tuning-based, memory-augmented, streaming, and recursive-context baselines on distributional quality, semantic alignment, identity consistency, temporal smoothness, motion stability, transition coherence, and human preference. These results show that compact prompt routing and lightweight temporal adaptation provide sufficient controllable capacity for stable long video extrapolation.
