Search papers, labs, and topics across Lattice.
This paper identifies a critical architectural flaw in Vision-Language-Action (VLA) models that leads to significant performance drops when instructions are paraphrased, despite the models retaining task identity. By introducing Grounded Semantic Re-binding (GSR), the authors effectively decouple the encoding of visual features and task semantics, allowing for the training of a new action expert that dramatically improves robustness to instruction variations. The proposed method achieves up to a 44.6% increase in success rates on the LIBERO-Para benchmark and sets a new state-of-the-art PRIDE score of 70.4, demonstrating that structural design can enhance instruction generalization without extensive data scaling.
GSR enables lightweight models to outperform heavily scaled counterparts, achieving near-perfect robustness to instruction rewording.
Vision-Language-Action (VLA) models excel in robotic manipulation but suffer catastrophic performance drops when canonical instructions are simply paraphrased. Although this brittleness is typically addressed through costly data scaling, our probing reveals that the root cause is architectural rather than a lack of semantic understanding. Specifically, we demonstrate that current VLAs successfully retain the correct task identity internally. The failure actually stems from the joint encoding of dynamic visual observations and text, which introduces systematic feature shifts. Because the downstream action policy is highly vulnerable to these variations, it fails to translate the preserved semantics into correct control commands. To resolve this structural bottleneck, we propose Grounded Semantic Re-binding (GSR), an elegant intervention that bypasses unstable joint routing by explicitly fusing independently extracted task semantics with native visual features to train a completely re-initialized action expert from scratch. This targeted intervention dramatically restores paraphrastic invariance using only canonical demonstrations. On the LIBERO-Para benchmark, GSR improves success rates by up to 44.6 percent. It enables lightweight models to rival massively scaled baselines and pushes state-of-the-art models to a new record PRIDE score of 70.4, outperforming the recently introduced large-scale pretrained model Xiaomi-Robotics-0 in instruction generation capabilities. Building on these insights, we also introduce ParaVLA, a natively decoupled 0.33B-parameter model exhibiting near-perfect robustness to instruction rewording. Ultimately, our work proves that robust semantic grounding can be achieved through elegant structural design, bypassing the inefficient brute-force data scaling paradigm.
