Search papers, labs, and topics across Lattice.
This paper introduces an adaptive action chunking method for Vision-Language-Action (VLA) frameworks that leverages internal cross-attention dynamics to optimize execution horizons. By analyzing the dispersion and entropy of action-to-observation cross-attention, the authors identify a signal indicating when the current observation is insufficient for further open-loop execution, allowing for dynamic adjustment of the execution horizon. Evaluations demonstrate that this approach enhances task success rates across multiple benchmarks while maintaining efficient closed-loop control, outperforming both fixed-horizon and traditional adaptive chunking methods.
Action chunking can be dynamically optimized using internal cross-attention signals, leading to significantly improved task success rates in VLA frameworks.
Action chunking is a standard execution strategy in modern Vision-Language-Action (VLA) frameworks, but fixed execution horizons impose a trade-off between efficiency and accuracy. Short chunks require frequent inference and may cause oscillatory behavior, whereas long chunks can become misaligned with newly observed states. We address this limitation with an adaptive action chunking approach based on internal cross-attention dynamics in the action expert. We observe that, as the prediction horizon extends, action-to-observation cross-attention becomes increasingly dispersed and its entropy rises toward a plateau. This pattern is associated with higher action prediction error and provides an online signal that the current observation offers limited grounding for further open-loop execution. Based on this observation, we introduce a training-free truncation mechanism that detects sustained high-entropy plateaus and dynamically selects the execution horizon during inference. The method uses attention weights already computed by the policy and introduces negligible additional overhead. Evaluations on $\pi_{0.5}$ and X-VLA across RoboTwin 2.0, LIBERO, and three real-world manipulation tasks show improved average task success over fixed-horizon and adaptive chunking baselines, while preserving efficient closed-loop control. These results show that cross-attention dynamics can provide a practical internal signal for adaptive action execution in VLAs.