Search papers, labs, and topics across Lattice.
TBD-VLA introduces a novel framework for discrete Vision-Language-Action (VLA) models that enhances action generation by integrating block diffusion to account for temporal structures in action trajectories. By partitioning action sequences into temporal blocks and employing masked discrete diffusion within these blocks while maintaining autoregressive generation, the model achieves both improved inference speed and strong temporal coherence. Experimental results demonstrate that TBD-VLA significantly outperforms existing VLA methods in both simulated environments and real-world manipulation tasks, marking a substantial advancement in the efficiency and effectiveness of VLA models.
Temporal action generation just got a major upgrade鈥擳BD-VLA combines block diffusion with autoregressive decoding to boost inference speed and coherence.
Discrete Vision-Language-Action (VLA) models typically formulate action generation as next-token prediction over discretized action spaces, conditioning each token autoregressively on prior context. While effective, this paradigm incurs high inference latency and largely ignores the temporal structure inherent in action trajectories. Recent efforts introduce parallel decoding to improve efficiency, enabling faster inference, but lack explicit mechanisms for modeling token dependencies. We introduce TBD-VLA, a discrete token-based VLA framework that incorporates block diffusion to enable temporal action generation. We partition action sequences into temporal blocks and perform masked discrete diffusion within each block, while maintaining autoregressive generation across blocks. This design unifies temporal autoregression and parallel action decoding, achieving both strong temporal coherence and improved inference speed. In addition, the explicit temporal modeling enables asynchronous execution of action chunks (e.g., Real-Time Chunking) via temporal in-painting. TBD-VLA significantly outperforms prior VLA approaches in both simulation and real-world manipulation tasks, offering a scalable path toward fast, temporally aware, discrete VLA models. Project webpage: https://tbd-vla.github.io/
