Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
VersaCamVLA addresses the brittleness of Vision-Language-Action (VLA) models to camera configuration changes by learning a unified scene-token interface that maps variable RGB views into fixed-size latent tokens. This is achieved through multi-signal target-view prediction and Wrist-Augmented Pose Sampling (WAPS) to generate diverse pose data. The framework enables a lightweight spatial encoder to inject these compact scene tokens as supplementary visual conditions into pretrained VLAs, demonstrating robust performance across varied camera setups on multiple benchmarks and a real robot.
Robots can now adapt to any camera setup without retraining, simply by injecting compact scene tokens into existing VLA models.
Vision-Language-Action (VLA) models have emerged as powerful foundations for robotic manipulation, but their reliance on fixed camera configurations during training makes them brittle to changes in camera count or pose during deployment. To overcome these limitations, we propose VersaCamVLA, a camera-configurable framework that decouples camera-set representation from action learning. VersaCamVLA learns a unified scene-token interface that maps an arbitrary, variable set of posed RGB views into fixed-size latent scene tokens. This is achieved via multi-signal target-view prediction and Wrist-Augmented Pose Sampling (WAPS), which leverages natural wrist-camera motion for free pose diversity. At deployment, a lightweight spatial encoder injects these compact scene tokens into a pretrained base VLA as a supplementary visual condition, requiring no explicit 3D sensing or novel-view rendering. Experiments on RoboTwin, LIBERO, and a real-robot platform demonstrate that VersaCamVLA consistently outperforms prior VLA methods and direct multi-view baselines, maintaining robust performance across varying camera counts and unseen camera poses.