Search papers, labs, and topics across Lattice.
This paper introduces Task-State Representation (TSR), a novel framework designed to decouple persistent task states from transient screen observations in long-horizon mobile GUI agents. By maintaining a structured approach that includes a global instruction summary, a dynamic progress tracker, and a transition-aware action verifier, TSR alleviates the context burden that often leads to agent errors such as forgetting initial requirements or hallucinating progress. Experiments demonstrate that TSR significantly enhances agent performance, achieving up to a 12-point increase in success rates on complex tasks across four mobile GUI benchmarks.
Agents using TSR can maintain clarity in task execution, boosting success rates by up to 12 points on challenging mobile GUI tasks.
While long-horizon mobile GUI agents typically rely on thought-action-observation loops, they struggle to separate persistent task states from transient screen observations. As execution histories grow, this entanglement imposes a severe context burden, causing agents to forget initial requirements, hallucinate progress, or repeatedly interact with stale interfaces. To address this, we introduce Task-State Representation (TSR), a training-free framework that explicitly decouples task state from sensory input. Acting as a lightweight external wrapper, TSR maintains three structured components: a global instruction summary, a dynamic progress tracker for subgoals, and a transition-aware action verifier. By continuously updating through pre- and post-action visual comparisons, TSR effectively guides the agent's reasoning without requiring architectural modifications. Experiments across four mobile GUI benchmarks validate TSR's effectiveness, yielding up to a 12 absolute point increase in success rate on complex cross-application and memory-intensive tasks.
