Search papers, labs, and topics across Lattice.
This paper introduces Unified Visuomotor Targets (UVT), a novel approach that redefines the training objective for Visuomotor Action (VLA) models by integrating motor control and visual scene transition information into a single latent prediction target. By shifting the focus from low-level action predictions to a more holistic representation, UVT enhances training efficiency and policy robustness without requiring architectural modifications or additional data. The method demonstrates significant improvements in performance across simulation benchmarks and real-world bimanual manipulation tasks, particularly under constrained training conditions.
Shifting the training focus from low-level actions to a unified representation can dramatically enhance the efficiency and robustness of robot learning systems.
VLA models are trained to predict robot actions from visual and language observations. This is a natural choice, but it creates a mismatch: VLMs encode rich, high-level representations of scenes and goals, while robot actions are low-level signals with limited task structure. We ask whether changing what the policy is trained to predict, rather than how it is architecturally designed, can yield better and more efficiently trained policies. We propose UVT (Unified Visuomotor Target), a unified latent prediction target that jointly encodes motor control and visual scene transition information, requiring no architectural changes and no additional data. Applied to two representative VLA systems across simulation benchmarks and real bimanual manipulation tasks, UVT improves training efficiency, final task performance, and policy robustness, with particularly strong gains under limited training budgets and challenging environmental conditions. Rollout videos and additional qualitative results are available at our project webpage: https://unified-visuomotor-targets.github.io/
