Search papers, labs, and topics across Lattice.
This paper introduces a neuro-symbolic safety guidance mechanism for Vision-Language-Action (VLA) models that enhances predictive collision avoidance during robotic manipulation tasks. By formulating safety enforcement as a minimum-norm constrained optimization problem, the approach corrects safety violations during the denoising of trajectory predictions, allowing for proactive rather than reactive safety measures. The results demonstrate a significant improvement in collision avoidance (82.8%) and task success (81.6%) on the SafeLIBERO benchmark, particularly benefiting long-horizon tasks where traditional methods struggle with distribution shifts.
Predictive collision avoidance in robotic manipulation is now achievable, with a 19.8% boost in task success over conventional methods.
Vision-Language-Action (VLA) models have demonstrated promising generalization capabilities across robotic manipulation tasks, yet their real-world deployment remains limited by the lack of effective safety measures. Specifically, existing safety measures only prevent collisions caused by the robot's next action. In this paper, we propose a neuro-symbolic safety guidance mechanism for flow matching based VLAs that enables predictive collision avoidance. Flow matching based VLAs determine the next actions by predicting a trajectory (a sequence of actions) through an iterative neural flow matching process. Our method formulates safety enforcement as a minimum-norm constrained optimization problem that corrects safety violations during the denoising process of noisy intermediate trajectory predictions. By analyzing predicted trajectories and applying corrections during iterative denoising, our approach anticipates collisions before they become unavoidable. This interleaving of symbolic constraint satisfaction with neural trajectory generation enables predictive collision avoidance rather than reactive intervention. On the SafeLIBERO benchmark, our method achieves 82.8% collision avoidance and 81.6% task success, a 6.3% and 19.8% improvement respectively over single-step methods, with the largest gains on long-horizon tasks where compounding distribution shift is most pronounced. Video demonstrations of our approach are included on our project page at https://willenglish.tech/SafetyGuidedFlowMatching/.
