Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
To overcome the computational bottleneck of Vision-Language-Action (VLA) models, this work introduces TVCache, a training-free token caching framework that harnesses text-vision synergy for efficient inference. TVCache mitigates head-wise aggregation noise and representation instability by filtering attention heads via multimodal focus and assigning cache reuse based on inter-layer text-vision entropy differences. Across four VLA backbones, simulation suites, and real-world robot evaluations, TVCache beats existing caching baselines by up to 14.5 percentage points in task success at 12.5% token retention while achieving a 2.45x FLOP reduction.
Visual token pruning often degrades robotic control because it ignores language conditioning; steering token cache reuse via text-vision entropy differentials cuts VLA compute by 2.45x while boosting task success by up to 14.5%.
Vision-Language-Action (VLA) models enable generalizable robotic control but remain computationally expensive. Token caching provides a training-free, plug-and-play acceleration alternative. However, existing VLA caching does not fully exploit a key inductive bias of VLA models: text-vision synergy, wherein textual semantics guide the precise visual grounding of task-relevant regions. In particular, existing designs insufficiently account for head-wise reliability in attention aggregation and layer-wise stability in cache reuse. To address this, we propose Text-Vision Synergistic Token Caching (TVCache), a training-free framework for efficient VLA inference. TVCache filters attention heads based on text-vision information focus to improve task-relevant and physically consistent visual grounding. Concurrently, we introduce a reuse-layer selection mechanism guided by text-vision entropy differences to avoid caching unstable representations and improve cache resource allocation. Extensive experiments across four representative VLA models, two simulation benchmarks, and real-world robotic tasks demonstrate the effectiveness and generality of TVCache. At matched token-retention ratios, TVCache consistently improves task success over existing VLA caching with comparable computational cost. On OpenVLA-OFT, it improves average success by up to 14.5 percentage points over VLA-Cache at 12.5% retention while reducing FLOPs by 2.45x relative to full-token inference.