Search papers, labs, and topics across Lattice.
This paper introduces XCoT-VLA, a novel approach that enhances Vision-Language-Action models for autonomous driving by replacing verbose natural-language Chain-of-Thought with compact executable tokens derived from Reason-Action supervision. The method leverages logged trajectories and scene context to optimize real-time control, achieving significant reductions in longitudinal and lateral error metrics during driving tasks. Key results show that XCoT-VLA can represent driving-oriented reasoning with just 2-6 executable tokens, drastically cutting down on reasoning overhead while maintaining real-time performance.
Executable reasoning in autonomous driving can be achieved with just 2-6 tokens, slashing the overhead of traditional methods while improving trajectory accuracy.
Vision-Language-Action (VLA) models can connect scene understanding, semantic reasoning, and trajectory generation for autonomous driving. However, verbose natural-language Chain-of-Thought (CoT) is poorly suited to real-time control because it is open-ended, costly to decode, and difficult to optimize as an action-facing representation. We propose XCoT-VLA, which replaces descriptive rationales with compact executable CoT tokens learned from automatically constructed Reason-Action supervision. Logged trajectories provide action evidence, while scene context supplies causal semantics. The predicted XCoT sequence remains in context and conditions fixed trajectory queries through shared multimodal self-attention. Deterministic token-function routing applies the Reason FFN to XCoT tokens and the Control FFN to trajectory queries for flow-matching trajectory generation. We further introduce XCoT Policy Optimization (XCPO) as an optional refinement extension in the same executable token space. XCoT-VLA reduces longitudinal ADE from 1.645 to 1.323 on a general-distribution set and lateral FDE from 1.616 to 0.648 in lane-change scenarios. By representing driving-oriented reasoning with only 2-6 executable XCoT tokens, our method substantially reduces autoregressive reasoning overhead and remains within the real-time planning budget. These results demonstrate that driving-oriented reasoning can be compact, executable, and directly connected to trajectory generation.
