Search papers, labs, and topics across Lattice.
The paper introduces BehaviorVLA, a framework for learning temporally coherent behavioral representations in Vision-Language-Action models to improve generalization across environments. It uses a causal Mamba-based Visuomotor Behavior Encoder (VBE) to aggregate long-horizon trajectory information and a Phase-conditioned Behavior Decoder (PBD) to decode this into actions. Experiments on RoboTwin 2.0, LIBERO, and CALVIN show state-of-the-art performance and improved data efficiency in sim-to-real transfer compared to OpenVLA-OFT.
Mamba strikes again, enabling VLA models to learn more robust manipulation policies that generalize better to real-world scenarios and require less training data.
Vision-Language-Action (VLA) models often suffer from performance degradation under distribution shifts, as they struggle to learn generalized behavior representations across varying environments. While existing approaches attempt to construct behavior representations through action-centric latent variables, they are often limited by short-horizon temporal fragmentation and static execution-alignment, leading to inconsistent behaviors in complex scenarios. To address these limitations, we propose \textbf{BehaviorVLA}, a framework that facilitates robust manipulation through the learning of a temporally coherent behavioral representations. Our approach features two symmetric components: (1) the \textbf{Visuomotor Behavior Encoder (VBE)}, which utilizes a causal Mamba-based architecture to aggregate long-horizon trajectory information into a unified behavior representation; and (2) the \textbf{Phase-conditioned Behavior Decoder (PBD)}, which decodes this representation into precise actions by dynamically aligning task-level priors with real-time execution progress. Experiments on RoboTwin 2.0, LIBERO, and CALVIN demonstrate state-of-the-art success rates of 58\%, 98\%, and 4.36 (Avg.Len), respectively. Notably, in real-world sim-to-real transfer, BehaviorVLA matches the performance of OpenVLA-OFT using only 50\% of the demonstration data, showcasing its superior data efficiency and generalization.
