Search papers, labs, and topics across Lattice.
This paper introduces Causal Action Effect Reweighting (CAER), a novel training paradigm designed to enhance world model training by focusing on tokens whose predicted futures are causally influenced by agent actions. By contrasting predictions with and without action conditioning, CAER effectively redistributes supervision to optimize learning dynamics that are often overlooked in traditional mean squared error approaches. Experimental results demonstrate that CAER significantly improves physical consistency, controllability, and visual quality in action-conditioned video generation tasks compared to uniform MSE training.
CAER redefines how we train world models by ensuring that only the most relevant tokens drive learning, leading to substantial gains in video generation quality.
World models are becoming core infrastructure for embodied intelligence, with action-conditioned video generation providing controllable predictions of how scenes evolve after agent interventions. Yet existing models are commonly trained with space-time-uniform mean squared error, allowing abundant background tokens to dominate the gradient while sparse interaction dynamics remain under-optimized; such uniform fitting rewards reconstructing appearance rather than learning how actions change the world. We introduce Causal Action Effect Reweighting (CAER), a general training paradigm that redistributes supervision toward the tokens whose predicted future is causally affected by the action. CAER contrasts the model's own predictions with and without action conditioning to localize these tokens online, then normalizes the resulting effect map into a weight that preserves the total coefficient mass and changes only where it is spent. This online signal requires no external annotations or offline preprocessing, avoids additional data-processing time, and scales naturally with model and dataset size. Experiments across heterogeneous action-conditioned world-model tasks show that CAER converges to better solutions than uniform MSE training, with consistent improvements in the physical consistency, controllability, and visual quality of generated videos.
Tsinghua AI