Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Reflective VLA, a novel approach to vision-language-action models that enhances generalization by conditioning decisions on observation-action-consequence triplets. By incorporating the effects of actions on the environment, the model effectively disambiguates deployment-specific factors that reactive policies struggle with, leading to improved performance in varied settings. Experimental results show that Reflective VLA outperforms a reactive baseline by 5.4 and 4.2 percentage points in success rates under distribution shifts, highlighting the importance of action consequences for generalization.
Action consequences, not just context length, are the secret sauce that boosts VLA models' generalization across diverse environments.
Most vision-language-action (VLA) models are reactive: they predict the next action from the current instruction and observation, implicitly assuming that the current observation fully specifies the action-relevant state. In embodied control, however, embodiment-specific factors such as camera-to-robot geometry, robot calibration, or systematic actuation bias are often hard to identify from a single observation. As a result, reactive policies cannot reliably disambiguate these factors in general, overfitting to training environments and generalizing poorly at deployment. We propose Reflective VLA, which conditions each decision on a context of observation-action-consequence triplets. Each triplet records not only what the robot observed and executed, but also how the scene changed afterward, exposing the deployment-specific mapping from actions to observed effects. Architecturally, Reflective VLA routes all observation modalities through the VLM under shared attention, so the action expert reasons directly over past triplets and the current observation. A block-causal mask enables parallel multi-frame training without leakage and supports KV-cached real-time inference. On standard LIBERO and SimplerEnv-Bridge, Reflective VLA preserves strong in-distribution performance. Under distribution shift on LIBERO-Plus and the harder LIBERO-Plus-Hard, it improves average success rate by 5.4 and 4.2 percentage points over a matched reactive baseline. Ablations with a matched history-only baseline further show that action consequences -- rather than additional context length alone -- are the key to cross-environment generalization. Project page: https://lianqing11.github.io/reflective-vla-page/