Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
WARP-VLA addresses the critical challenge of view-sensitivity in Vision-Language-Action (VLA) models for robotic manipulation, particularly with wrist-mounted cameras where pose variations are common and difficult to control. The proposed Mixture-of-Experts (MoE) architecture learns view-specific feature transformations, enabling robust policy execution without explicit camera extrinsic inputs. This approach significantly improves success rates under wrist-view perturbations, demonstrating effective adaptation and transferability to real-world deployment.
Wrist-mounted cameras can now drive VLA policies robustly across diverse configurations, achieving a 2x success rate improvement by learning view-specific feature transformations within a Mixture-of-Experts framework.
Despite recent advances in Vision-Language-Action models (VLAs) for robotic manipulation, their performance remains sensitive to changes in camera configuration. The problem becomes more evident in cross-setup deployment, as reproducing the exact camera pose used for training is nearly impossible. Unlike fixed external views, wrist views are more challenging because the camera moves with the robot, causing even small mounting variations to alter fine-grained geometric cues. To address this, we propose WARP-VLA, a camera-view robust VLA for diverse wrist camera configurations. WARP-VLA adopts a Mixture-of-Experts (MoE) architecture where individual experts learn view-specific feature transformations, and a router combines them based on implicit view information. This allows the policy to be deployed without requiring camera extrinsic parameters as additional input. Through experiments on the LIBERO benchmark, WARP-VLA improves the average success rate of pi-0.5 from 39.2% to 78.3% under wrist-view perturbations. The real-robot experiments further show that the feature-level adaptation learned in simulation successfully transfers to diverse deployment settings. To facilitate reproducibility and future research, we release our wrist viewpoint robustness benchmark and a plug-and-play implementation.