Search papers, labs, and topics across Lattice.
This paper introduces a novel safety filter for Vision-Language-Action (VLA) models that leverages attention heads to identify intended targets and treat other scene elements as obstacles, enabling real-time collision avoidance. By integrating a lightweight object tracker with a Control Barrier Function (CBF), the proposed method addresses the limitations of existing safety filters that cannot adapt to moving obstacles. Evaluated on the SafeLIBERO benchmark, the approach not only matches oracle performance on static tasks but significantly outperforms it by 43% in dynamic scenarios, demonstrating the efficacy of utilizing internal model signals for safety.
Real-time safety filtering for VLA models can be achieved without additional training by harnessing attention heads to localize targets and avoid collisions with moving obstacles.
Vision-Language-Action (VLA) models have demonstrated impressive end-to-end performance across a variety of robotic manipulation tasks. However, these policies offer no guarantees against collisions with task-irrelevant objects in the scene. Existing safety filters sidestep this problem by querying a vision-language model (VLM) to identify obstacles and their locations. This, however, is too slow to run in the control loop and can only be invoked at episode initialization, leaving the filter unable to track moving obstacles. We discover that a small number of attention heads within a VLA model reliably localize the object the policy intends to approach. These heads can be exploited within a training-free safety framework that obtains the active target from the attention heads at every step, treats the remainder of the scene as obstacles, and feeds these into a Control Barrier Function (CBF) filter. Together with a lightweight real-time object tracker, this allows for collision avoidance for non-static obstacles. We evaluate our framework on SafeLIBERO, which we extend with moving obstacles. On the original static benchmark, our method performs comparably to an oracle that uses privileged simulator state to identify the target, emulating a VLM-based identification step run once at episode initialization. On the dynamic variant, where the oracle's init-time target assignment becomes stale, our method substantially outperforms it by 43%, on average. Our findings suggest that the perceptual signals needed for real-time safety filtering are already present within VLA policies and can be exploited without additional training or heavy auxiliary models.
