Search papers, labs, and topics across Lattice.
This paper introduces Faster-WAM, a novel World Action Model that utilizes the Dock of Transformer (DoT) architecture to decouple the depth of action modules from video backbones, significantly reducing computational overhead and inference latency. By connecting lightweight output-heads to a pretrained 30-layer video Transformer, Faster-WAM achieves competitive performance on benchmark tasks like LIBERO and RoboTwin 2.0 without additional embodied pretraining. The model not only demonstrates strong out-of-distribution generalization but also achieves an impressive 3.2x speedup in inference latency, making it a promising advancement in action prediction efficiency.
A single-layer action head on a 30-layer video backbone enables Faster-WAM to achieve a 3.2x speedup in inference latency while maintaining competitive performance and robust generalization.
World Action Models (WAMs) couple robot action prediction with video world models. Existing WAMs with shared-backbone and Mixture-of-Transformers designs generally tie the depth of the action module to that of the video backbone, resulting in substantial computational overhead and high inference latency. To address this limitation, we introduce Dock of Transformer (DoT), a video-centric design principle that treats a pretrained video Transformer as a representation hub and connects lightweight output-heads through docking interfaces. This enables flexible output-head design while providing direct access to representations from all layers of the backbone. We then introduce \textbf{Faster-WAM}, an instantiation of DoT for WAMs, which docks a single-layer action head onto a 30-layer video backbone. The docking interface fuses keys and values from all video layers and applies RoPE realignment. Without additional embodied pretraining, Faster-WAM achieves competitive performance on LIBERO and RoboTwin 2.0 while demonstrating strong out-of-distribution generalization on LIBERO-Plus. Faster-WAM also achieves the lowest end-to-end latency in our controlled comparison, requiring only 66.5 ms per inference --- a \(3.2\times\) speedup over Fast-WAM. Overall, these results demonstrate that the video-centric DoT architecture supports flexible task-specific head design while delivering low inference latency, strong action-prediction performance, and robust generalization.
