Search papers, labs, and topics across Lattice.
This paper introduces the Modality Masking Mechanism (M3), a training-only strategy designed to enhance the robustness of Query-based Vision-Language-Action (VLA) models for bimanual robotic manipulation by stochastically masking modality channels during training. The authors demonstrate that M3 significantly reduces execution failures in complex dual-arm tasks by encouraging the model to focus on reliable cues rather than distractions. Evaluations on ten bimanual tasks and three real-world scenarios reveal that M3 improves task success rates by up to 30% compared to baseline methods, highlighting its effectiveness without requiring architectural changes or extensive pretraining.
Stochastic modality masking during training can boost bimanual robotic manipulation success rates by over 30% without complex architectural changes.
Query-based Vision-Language-Action (VLA) models offer low-latency inference that is attractive for bimanual robotic manipulation, but we observe that they can still exhibit discontinuous actions and execution failures in complex dual-arm tasks. We hypothesize that unstable multi-view and language fusion is one contributing factor in these failures, often coinciding with attention spreading to distracting regions. To improve robustness, we introduce the Modality Masking Mechanism (M3), an embarrassingly simple, training-only strategy that requires no architectural changes or large-scale robot pretraining. M3 stochastically masks subsets of modality channels during training, exposing the policy to controlled partial observations and encouraging it to rely less on distracting cues and more on evidence that remains reliable. We evaluate M3 on ten bimanual tasks from RoboTwin 2.0 and on three long-horizon real-world tasks. Compared with the Adapter baseline, M3 improves average success by 21.7% in the Clean setting and 11.4% in Clean2Rand, where policies are trained on clean demonstrations and evaluated on randomized scenes, while also improving averaged real-world full-task success by over 30%. These results suggest that structured training-time masking is a practical way to improve the robustness of query-based VLA policies for bimanual manipulation.
