Search papers, labs, and topics across Lattice.
This paper introduces Co-VLA, a coordination-aware framework for dual-arm robotic manipulation that integrates explicit structural priors into vision-language-action models. By replacing the traditional monolithic action head with a Structured Action Expert (SAE), Co-VLA enhances bimanual coordination through a modular coordination-aware loss that differentiates task-level intent from execution adjustments. Experimental results demonstrate that Co-VLA achieves a 27% improvement in success rates for tightly coordinated tasks and more than doubles performance in out-of-distribution real-world scenarios, while also reducing task completion time by up to 25%.
Explicit coordination in dual-arm robotics can boost task success rates by 27% and significantly enhance real-world performance.
Vision-language-action (VLA) models show strong capabilities in single and dual-arm robotic manipulation. Prior works show coordinated bimanual behaviors can emerge from end-to-end learning, leveraging large vision-language backbones with continuous action prediction. However, as bimanual tasks become tightly coupled and execution constraints become critical, implicit coordination alone is insufficient to ensure reliable, interpretable, and stable behavior. In this work, we propose Co-VLA, a coordination-aware bimanual manipulation framework introducing explicit structural priors into VLA models. We instantiate our method on a state-of-the-art vision-language backbone by replacing its monolithic action head with a Structured Action Expert (SAE) designed for bimanual coordination. Specifically, we introduce explicit structure at the action generation level with a modular coordination-aware loss that shapes shared and residual latents according to task-specific structures. The shared latent encodes task-level coordination intent, while residual latents capture execution adjustments for each arm. At deployment, a Latent-Aware Controller (LAC) interprets the learned representations to modulate synchronization strength, execution asymmetry, smoothness, and safety constraints in real time. LAC operates at the joint-command level and remains compatible with standard control pipelines without requiring force or impedance control. Experiments across simulation and real-world benchmarks show Co-VLA significantly outperforms monolithic baselines, achieving a 27% success rate gain in tight-coordination tasks, more than doubling performance in OOD real-world scenarios (from 13% to 27%), and reducing task completion time by up to 25%.
