Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces ImageWAM, a novel framework that leverages pretrained image editing models for robot action prediction, challenging the necessity of video generation in World Action Models (WAMs). By focusing on action-relevant visual differences rather than generating full video sequences, ImageWAM significantly reduces computational costs and latency while maintaining superior performance in various simulation and real-world tasks. The results show that ImageWAM outperforms traditional video-based WAMs, achieving a reduction in FLOPs to 1/6 and latency to 1/4, while effectively concentrating on task-relevant changes.
ImageWAM shows that image editing can outperform video generation in robot action prediction, cutting costs and improving efficiency.
World Action Models (WAMs) commonly rely on video generation to bridge visual world modeling and robot control. However, video-based WAMs face three coupled limitations: dense multi-frame future tokens make inference costly, full video prediction spends capacity on action-irrelevant temporal and appearance details, and long-horizon future imagination may introduce errors that mislead action prediction. These issues raise a simple question: Does world action model really need video generation? We propose ImageWAM, a simple WAM framework that repurposes pretrained image editing models for robot action prediction. In contrast to video generation, image editing provides a better-matched prior: it only needs to model a target-frame transformation, focuses on action-relevant current-to-target visual differences, and grounds task instructions to localized visual changes through edit pretraining. In practice, ImageWAM does not decode the target frame at inference time; instead, it conditions a flow-matching action expert on the KV caches produced by image-editing denoising, using them as a compact world-action context. ImageWAM outperforms standard VLA baselines and matching competitive WAMs without additional policy pretraining across different simulator and real-world experiments. It also reduces FLOPs to 1/6 and latency to 1/4 of video-based WAMs. Attention analysis further shows that editing caches focus on task-relevant change regions, supporting image editing as an effective alternative to video-based world-action modeling.
Tsinghua AI