Search papers, labs, and topics across Lattice.
SimpleMemVLA eliminates dedicated memory modules in vision-language-action policies by feeding uncompressed, timestamped historical video directly into a native video-pretrained VLM backbone. To bridge historical context to execution without high inference costs, the backbone routes history through the hidden states of an intermediate generated sub-task into a flow-matching action head, while asynchronous prefix prefilling keeps latency comparable to single-frame models. Across four long-horizon manipulation benchmarks, this native approach sets a new state of the art, significantly outperforming retrieval, compression, and recurrent baselines while causal probes verify genuine reliance on temporal history.
Dedicated memory architectures for VLAs are largely obsolete: feeding intact video history directly into modern backbones beats complex retrieval and compression mechanisms by a wide margin while prefix caching keeps latency at single-frame speeds.
Long-horizon manipulation is partially observable: the information needed to choose the next action may appear only in observations from minutes earlier. Existing memory mechanisms: retrieval banks, learned compressors, recurrent states must decide what to keep from the past before knowing what a future decision will require. This was motivated by the assumption that minute-scale history is too large to process directly, which modern VLM backbones no longer make true. In this work, we introduce SimpleMemVLA, a VLA without a dedicated memory module. It keeps the sampled history intact and passes it to the backbone in the timestamped video format the backbone was pretrained to process; the hidden states of a generated sub-task then form the only channel from history to a standard flow-matching action head. Since consecutive decisions share most of their history, prefilling the shared prefix during action execution keeps latency close to a single-frame VLA. SimpleMemVLA sets a new state of the art on four memory benchmarks without cost on general-purpose control. Holding the backbone and training setup fixed, it outperforms retrieval, compression and recurrent-state mechanisms by a wide margin, and causal interventions confirm that the policy genuinely reads its history. Code available at https://github.com/wadeKeith/SimpleMemVLA
