Search papers, labs, and topics across Lattice.
The paper introduces AndroidWorld-Generalization, a new benchmark for evaluating zero-shot generalization in GUI-based mobile agents trained with reinforcement learning. They formalize the problem as a Contextual Markov Decision Process (CMDP) and propose an RL training system integrating Group Relative Policy Optimization (GRPO) with a scalable rollout collection system. Experiments show that RL-trained 7B VLM agents outperform supervised baselines on unseen task instances, but generalization to unseen templates and apps remains challenging, highlighting the need for further research in few-shot adaptation.
Mobile agents trained with RL struggle to generalize to new app interfaces, improving only 8.3% compared to supervised baselines, despite a 26.1% gain on unseen task instances.
Graphical user interface (GUI)-based mobile agents automate digital tasks on mobile devices by interpreting natural-language instructions and interacting with the screen. While recent methods apply reinforcement learning (RL) to train vision-language-model(VLM) agents in interactive environments with a primary focus on performance, generalization remains underexplored due to the lack of standardized benchmarks and open-source RL systems. In this work, we formalize the problem as a Contextual Markov Decision Process (CMDP) and introduce \textbf{AndroidWorld-Generalization}, a benchmark with three increasingly challenging regimes for evaluating zero-shot generalization to unseen task instances, templates, and applications. We further propose an RL training system that integrates Group Relative Policy Optimization (GRPO) with a scalable rollout collection system, consisting of containerized infrastructure and asynchronous execution % , and error recovery to support reliable and efficient training. Experiments on AndroidWorld-Generalization show that RL enables a 7B-parameter VLM agent to surpass supervised fine-tuning baselines, yielding a 26.1\% improvement on unseen instances but only limited gains on unseen templates (15.7\%) and apps (8.3\%), underscoring the challenges of generalization. As a preliminary step, we demonstrate that few-shot adaptation at test-time improves performance on unseen apps, motivating future research in this direction. To support reproducibility and fair comparison, we open-source the full RL training system, including the environment, task suite, models, prompt configurations, and the underlying infrastructure \footnote{https://github.com/zihuanjiang/AndroidWorld-Generalization}.
