Search papers, labs, and topics across Lattice.
This paper identifies and addresses Positional Blind Spots (PBS) in Vision-Language-Action (VLA) models, which are areas in the workspace where performance significantly deteriorates due to spatially localized factors, even when other conditions are controlled. By employing a two-stage black-box framework that first uncovers these PBS through a one-sided log-likelihood-ratio test and then mitigates their impact via targeted fine-tuning using LoRA, the authors demonstrate substantial improvements in model performance. The results reveal that PBS are widespread across various VLA policies, with targeted interventions reducing failure rates by up to 85.19%.
Positional Blind Spots in VLA models can lead to failure rates as high as 58%, but targeted fine-tuning can dramatically reduce these failures by over 40%.
Recent Vision-Language-Action (VLA) models achieve promising performance in robotic manipulation, typically measured by success rates aggregated over predefined object configurations, an evaluation that implicitly assumes spatially uniform competence across the workspace. However, this assumption does not hold: even with the instruction and every other scene factor held fixed, merely relocating a task-irrelevant distractor can sharply raise the failure probability within localized, spatially coherent regions, which we term Positional Blind Spots (PBS). In this paper, we propose a two-stage black-box framework to uncover and mitigate PBS. During the uncovering stage, we grid the workspace and apply a one-sided log-likelihood-ratio test to localize PBS cells with significantly elevated risk. During the mitigation stage, we fine-tune the policy via LoRA on demonstrations collected from these PBS regions, improving competence there while largely preserving performance across the rest of the workspace. We evaluate our framework on five state-of-the-art VLA policies across two benchmarks, and find that PBS are pervasive and spatially concentrated in all of them, with failure rates up to 0.58. Our search strategy achieves an average F1-score of 0.678, outperforming random search and adaptive sampling baselines by 0.268 and 0.178, respectively. Guided by the discovered regions, targeted fine-tuning reduces the overall failure rate by 40.00%--85.19%.
