Search papers, labs, and topics across Lattice.
This paper introduces OnEvoMemory, a novel value-guided memory module that enhances pretrained robot policies by effectively managing memory of past experiences during long-horizon manipulation tasks. By leveraging offline demonstrations for initial memory setup and refining memory selection through online rollouts, the approach enables robots to track critical interactions and avoid redundant actions. Experimental results demonstrate that OnEvoMemory significantly boosts the performance of the base VLA policy on long-horizon manipulation benchmarks, showcasing its effectiveness in real-world applications.
OnEvoMemory allows robots to evolve their memory in real-time, leading to improved task performance and reduced redundancy in long-horizon manipulation tasks.
Long-horizon robot manipulation requires policies to track completed subtasks and critical interaction events. However, existing memory mechanisms heavily rely on external models or predefined update rules. To address this, we propose OnEvoMemory, a value-guided memory module for pretrained robot policies. It maintains recent context, high-value experiences, and salient transitions, while learning which experiences should be retained from trajectory outcomes. Offline demonstrations initialize the memory prior, whereas successful and unsuccessful online rollouts refine memory selection, helping the policy recognize task-stage transitions and avoid repeating completed subtasks. Experiments on long-horizon manipulation benchmarks show that OnEvoMemory improves the performance of the base VLA policy through both offline initialization and online memory evolution.
Tsinghua AI