Search papers, labs, and topics across Lattice.
This paper introduces ImageWAM, a novel framework that leverages pretrained image editing models to enhance robot action prediction, challenging the conventional reliance on video generation in World Action Models (WAMs). By focusing on action-relevant visual differences and utilizing flow-matching action experts, ImageWAM significantly reduces computational costs while improving performance over standard video-based approaches. The results demonstrate that ImageWAM not only outperforms existing WAMs in various environments but also achieves a remarkable reduction in both FLOPs and latency, highlighting the efficiency of image editing for action modeling.
ImageWAM achieves superior robot action prediction while slashing computational costs to one-sixth of traditional video-based models.
World Action Models (WAMs) commonly rely on video generation to bridge visual world modeling and robot control. However, video-based WAMs face three coupled limitations: dense multi-frame future tokens make inference costly, full video prediction spends capacity on action-irrelevant temporal and appearance details, and long-horizon future imagination may introduce errors that mislead action prediction. These issues raise a simple question: Does world action model really need video generation? We propose ImageWAM, a simple WAM framework that repurposes pretrained image editing models for robot action prediction. In contrast to video generation, image editing provides a better-matched prior: it only needs to model a target-frame transformation, focuses on action-relevant current-to-target visual differences, and grounds task instructions to localized visual changes through edit pretraining. In practice, ImageWAM does not decode the target frame at inference time; instead, it conditions a flow-matching action expert on the KV caches produced by image-editing denoising, using them as a compact world-action context. ImageWAM outperforms standard VLA baselines and matching competitive WAMs without additional policy pretraining across different simulator and real-world experiments. It also reduces FLOPs to 1/6 and latency to 1/4 of video-based WAMs. Attention analysis further shows that editing caches focus on task-relevant change regions, supporting image editing as an effective alternative to video-based world-action modeling.
Tsinghua AI