Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Next Forcing, a multi-chunk prediction (MCP) framework designed to enhance causal world modeling in autoregressive video generation. By employing lightweight auxiliary MCP modules that predict multiple future video chunks simultaneously, the method achieves a 93.1% relative improvement in training accuracy and 2.3x faster convergence at high frame rates compared to existing models. Additionally, it accelerates inference by allowing parallel predictions of video chunks, resulting in a 2x speedup while maintaining state-of-the-art performance on benchmarks like RoboTwin and PhyWorld.
Achieving a 93.1% improvement in training accuracy and 2x faster inference, Next Forcing redefines the efficiency of causal world modeling in video generation.
Autoregressive video generation has emerged as a powerful paradigm for World Action Models (WAMs). However, existing approaches suffer from slow training convergence and limited converged accuracy, particularly at high frame rates, as the training supervision is confined to the current chunk without explicit signals about future dynamics; they also suffer from slow inference due to iterative video denoising. In this paper, we present Next Forcing, a multi-chunk prediction (MCP) framework for causal world modeling that enables faster training, higher accuracy, and accelerated inference. Inspired by multi-token prediction in large language models, Next Forcing introduces an MCP training objective that augments the main model with lightweight auxiliary MCP modules to simultaneously denoise video chunks at multiple future temporal horizons (next^1, next^2, next^3 chunks). These MCP modules form a causal chain across prediction depths, where intermediate features fused from multiple layers of the main model are leveraged to predict future dynamics, allowing near-future predictions to inform farther-future ones and providing dense multi-scale temporal supervision back to the main model. During training, the MCP modules significantly accelerate convergence and improve converged accuracy, especially at high frame rates: at 50 fps, Next Forcing achieves a 93.1% relative improvement over LingBot-VA at 5k training steps and 2.3x faster convergence, and establishes new state-of-the-art results on the RoboTwin benchmark (94.1/93.5% on Clean/Random). At inference, the MCP modules can be retained to predict the next video chunk in parallel with the current one, achieving 2x inference acceleration. Next Forcing also demonstrates significant improvements on PhyWorld, a benchmark evaluating adherence to physical laws in video generation, and over 50% FVD reduction on general video pretraining.