Search papers, labs, and topics across Lattice.
This paper introduces a bimanual manipulation framework that employs Dual-Level Structural Decomposition to enhance policy learning by separately addressing visual relevance and interaction modes. The proposed method utilizes a View-Selective Visual Router to dynamically emphasize task-relevant visual cues and an Interaction-Aware Action Mixture-of-Experts to adapt action generation to the varying modes of bimanual interaction. Evaluations on both simulated and real-world tasks show a significant improvement in success rates, with increases of 27.7% in simulation and 43.3% in real-world scenarios compared to monolithic baselines.
By integrating selective visual processing with adaptive action pathways, this framework achieves unprecedented success rates in bimanual manipulation tasks, outperforming traditional approaches.
In bimanual robotic manipulation, task-relevant visual information varies with the task stage and context, while the interaction of the two arms shifts between independent and coordinated modes, making policy learning challenging. However, existing monolithic Vision-Language-Action (VLA) policies process diverse visual inputs and interaction patterns through a single shared representation and action generation pathway, often failing to separately account for visual relevance and bimanual interaction structure. To address this issue, we propose a bimanual manipulation VLA framework based on Dual-Level Structural Decomposition. The View-Selective Visual Router dynamically adjusts wrist-view contributions to emphasize relevant visual cues, while the Interaction-Aware Action Mixture-of-Experts (MoE) decomposes action generation into coordinated and arm-wise pathways to adapt to varying bimanual interaction modes. We evaluate the proposed method on six simulated bimanual manipulation tasks in RoboTwin 2.0 and three long-horizon real-world tasks. Our model improves the overall average success rate over a monolithic baseline by 27.7% in simulation and 43.3% in real-world evaluation, while consistently outperforming single-module variants across both settings. These results demonstrate that jointly considering selective visual processing and explicit decomposition of bimanual interaction structures provides an effective inductive bias for robust bimanual manipulation.
