Search papers, labs, and topics across Lattice.
This paper introduces PROBEACT, a training-free intervention framework designed to enhance the robustness of Vision-Language-Action (VLA) models against common failure modes in robotic manipulation tasks. By integrating a lightweight hidden-state probe, a kinematic state machine, and a hierarchical Control Barrier Function, PROBEACT effectively detects and recovers from grasping and placement failures without altering the model's weights or requiring additional training. Evaluated on the LIBERO-plus benchmark, the framework significantly boosts the success rate of the OpenVLA-OFT model from 69.6% to 74.1%, showcasing its versatility across various VLA policies.
A training-free intervention can boost VLA model success rates by over 4% without any additional training or modifications.
Vision-Language-Action (VLA) models demonstrate strong perfor-1 mance on language-conditioned robotic manipulation within their training dis-2 tribution, yet their generalization capabilities remain fundamentally limited. They3 lack the robustness required to handle perturbations, frequently failing when con-4 fronted with lighting changes, altered camera viewpoints, or small initial-state5 variations. We propose PROBEACT, a training-free runtime intervention frame-6 work that detects and recovers from grasping and placement failures in pre-7 trained VLA policies without modifying their weights or requiring additional8 demonstrations. PROBEACT combines three components: (i) a lightweight multi-9 target hidden-state probe that predicts the 3D positions of task-relevant objects10 from intermediate VLA features, with Hungarian-matched identity tracking for11 multi-object scenes; (ii) an object-agnostic kinematic state machine that detects12 grasp, transport, and placement failures using only gripper-internal signals and13 end-effector kinematics; and (iii) a hierarchical Control Barrier Function (CBF)14 filter that encodes repeated-failure locations as soft safe-set constraints, mini-15 mally correcting VLA actions while preserving baseline behavior. As a plug-and-16 play, training-free intervention loop, PROBEACT is orthogonal to existing train-17 ing pipelines. Evaluated on the LIBERO-plus benchmark, our framework acts as18 a universal safety net, improving the success rate of the OpenVLA-OFT model19 from 69.6% to 74.1%, while demonstrating broad applicability to both base and20 fine-tuned VLA policies.
