Search papers, labs, and topics across Lattice.
This paper introduces ActionCache, an innovative external caching mechanism designed to enhance the efficiency of Vision-Language-Action (VLA) models by reusing past intermediate actions to reduce inference latency. By employing compact multimodal keys for action retrieval, ActionCache enables rapid warm-starting of action generation, significantly alleviating the computational bottleneck associated with iterative denoising processes. Experimental results show that ActionCache achieves remarkable inference acceleration, with reductions of up to 11.75脳 and 34.43脳 for the flow-based VLA models $\pi_{0.5}$ and GR00T-N1.6, respectively, while maintaining high task success rates in both simulated and real-world environments.
ActionCache can accelerate inference for VLA models by up to 34.43脳 without compromising task success rates, revolutionizing real-time robotic manipulation.
Vision-Language-Action (VLA) models have emerged as a promising approach for generalizable robotic manipulations. In particular, flow matching-based VLA models have shown remarkable success due to their capability to generate precise and smooth action sequences and capture multimodal distributions. However, the iterative denoising process in the action head acts as a major computational bottleneck, posing a critical challenge for real-time deployment. To address this challenge, we propose ActionCache, a plug-and-play external cache that opportunistically reuses past intermediate actions to warm-start generations from the vicinity of target actions, thereby drastically reducing the inference latency. Specifically, ActionCache stores the intermediate actions with compact multimodal keys, which enables retrieval from similar past contexts across different episodes or even different tasks. Experimental results in simulation and real-world environments demonstrate that ActionCache maintains high task success rates in a low-latency regime, achieving inference acceleration of up to $11.75\times$ and $34.43\times$ for representative flow-based VLA models, $\pi_{0.5}$ and GR00T-N1.6, respectively.