Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
To resolve the semantic misalignment between compression-based tokenizers and autoregressive backbones in Vision-Language-Action (VLA) models, the authors formulate CATok, a causal action tokenizer based on conditional flow-matching annealing. By extracting discrete tokens that progressively encode residual action reconstruction signals across noise scales, the method provides a coarse-to-fine causal token space paired with a Multimodal Diffusion Transformer (MMDiT) decoder that naturally insulates high-level semantic reasoning from continuous low-level execution. Across three simulation benchmarks and real-world robotic tasks, CATok matches the precision of hybrid diffusion-head architectures while outperforming existing tokenizers in reconstruction fidelity, downstream task success, and inference efficiency.
Purely autoregressive VLAs no longer require awkward hybrid diffusion heads to achieve fine-grained robot control: structuring discrete action tokenization as causally annealed flow matching recovers continuous diffusion precision while preserving end-to-end token efficiency.
Autoregressive Vision-Language-Action (VLA) models offer a scalable path to robot learning, yet existing action tokenizers treat tokenization as a compression problem, producing representations that are semantically misaligned with the autoregressive backbone. We propose CATok, a causal action tokenizer that reframes tokenization as a causally structured generative process. CATok introduces a conditional annealing mechanism that extracts action tokens by progressively annealing a flow-matching process: each token is conditioned on all preceding tokens and encodes the residual reconstruction signal at a specific noise level, establishing a coarse-to-fine causal token space whose generative semantics are structurally aligned with autoregressive modeling. A token-conditioned flow-matching decoder built on Multimodal Diffusion Transformer (MMDiT) reconstructs continuous action chunks from these discrete tokens with the precision of hybrid diffusion-head architectures. This discrete bottleneck enforces knowledge insulation by design, cleanly separating high-level semantic reasoning from low-level motor execution without requiring explicit attention masking. Extensive evaluations across three simulation benchmarks and real-world robotic manipulation tasks demonstrate that CATok consistently surpasses existing tokenization methods in both reconstruction fidelity-compression tradeoff and inference efficiency, while improving VLA task success rate and training efficiency, establishing a high-performance, scalable foundation for purely autoregressive VLA systems.
Tsinghua AI