Search papers, labs, and topics across Lattice.
This paper introduces Active Task Driving Memory (ATMem), a novel approach that transforms memory in GUI agents from passive storage to an actively maintained execution state that reflects the current role and status of task-relevant information. Using STR-GRPO, an online reinforcement learning method, the authors demonstrate that agents can selectively utilize ATMem to enhance task completion while minimizing unnecessary memory usage. The results show that agents equipped with ATMem significantly outperform traditional memory methods in executing long-horizon tasks, effectively managing similar entries and avoiding out-of-scope actions.
GUI agents can now leverage an actively maintained memory state to significantly improve task execution accuracy and efficiency over long horizons.
Mobile GUI agents increasingly face long-horizon tasks that require reading, updating, and reusing task-relevant data across pages and applications. Existing memory methods treat memory largely as passive storage, where past observations are accumulated and retrieved when needed. Yet retrieving a value does not reveal its current role in the workflow. The agent must still infer from accumulated records whether the value should be used now, has already been used, or must wait for a later dependency. This implicit reconstruction becomes unreliable in long trajectories with similar fields, repeated values, distractors, and outdated states, causing repeated or missed operations. We propose Active Task Driving Memory (ATMem), which shifts GUI-agent memory from passive storage to an actively maintained execution state. ATMem maintains task-relevant information as a continually updated execution state that links each value to its role and current status, enabling action selection based on the current workflow state. We therefore introduce \textbf{STR-GRPO}, an online reinforcement learning method that learns to use ATMem selectively according to its contribution to task completion. STR-GRPO contrasts memory-on and memory-off rollouts to estimate when memory use improves execution, while memory-cost-aware reward discourages costly memory usage that does not improve execution. To evaluate whether agents can complete all in-scope work while avoiding out-of-scope actions over long-horizon execution, we build a challenging mobile benchmark. From a list of near identical entries, agents must act on every entry that satisfies the instruction and reject entries that violate its constraints.
DAMO