Search papers, labs, and topics across Lattice.
SPIRAL is introduced as a closed-loop framework for controllable long-horizon video generation conditioned on high-level semantic actions, addressing limitations of open-loop approaches. It employs a PlanAgent to decompose abstract actions and a CriticAgent to evaluate intermediate results, enabling iterative refinement. The framework's closed-loop design facilitates RL-based optimization, leading to improved semantic alignment and temporal consistency, as validated on the newly introduced ActWM-Bench and other benchmarks.
By closing the loop with explicit planning and feedback, SPIRAL overcomes the temporal drift and weak semantic grounding plaguing one-shot video generation models.
We introduce SPIRAL, a self-improving planning and iterative reflective action world modeling closed-loop framework that enables controllable long-horizon video generation conditioned on high-level semantic actions. Existing one-shot video generation models operate in open-loop, often resulting in incomplete action execution, weak semantic grounding, and temporal drift. SPIRAL formulates ActWM as a closed-loop think-act-reflect process, where generation proceeds step by step under explicit planning and feedback. A PlanAgent decomposes abstract actions into object-centric sub-actions, while a CriticAgent evaluates intermediate results and guides iterative refinement with long-horizon memory. This closed-loop design naturally supports RL evolving optimization, improving semantic alignment and temporal consistency over extended horizons. We further introduce the ActWM-Dataset and ActWM-Bench for training and evaluation. Experiments across multiple TI2V backbones demonstrate consistent gains on ActWM-Bench and mainstream video generation benchmarks, validating SPIRAL's effectiveness.
NUS