Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces AutoWebWorld, a framework that synthesizes verifiable web environments by modeling them as Finite State Machines (FSMs) and using coding agents to translate these FSMs into interactive websites. This approach allows for programmatic verification of agent actions and task success, overcoming the limitations of real-world websites where state transitions are implicit and verification is costly. Experiments demonstrate that training Web GUI agents on AutoWebWorld-generated data significantly improves their performance on real-world benchmarks like WebVoyager and Online-Mind2Web, and that performance scales with the amount of synthetic data.
Forget scraping messy real-world websites: AutoWebWorld lets you synthesize infinite, perfectly verifiable web interaction data for just $0.04 a pop, dramatically boosting agent performance.
The performance of autonomous Web GUI agents heavily relies on the quality and quantity of their training data. However, a fundamental bottleneck persists: collecting interaction trajectories from real-world websites is expensive and difficult to verify. The underlying state transitions are hidden, leading to reliance on inconsistent and costly external verifiers to evaluate step-level correctness. To address this, we propose AutoWebWorld, a novel framework for synthesizing controllable and verifiable web environments by modeling them as Finite State Machines (FSMs) and use coding agents to translate FSMs into interactive websites. Unlike real websites, where state transitions are implicit, AutoWebWorld explicitly defines all states, actions, and transition rules. This enables programmatic verification: action correctness is checked against predefined rules, and task success is confirmed by reaching a goal state in the FSM graph. AutoWebWorld enables a fully automated search-and-verify pipeline, generating over 11,663 verified trajectories from 29 diverse web environments at only $0.04 per trajectory. Training on this synthetic data significantly boosts real-world performance. Our 7B Web GUI agent outperforms all baselines within 15 steps on WebVoyager. Furthermore, we observe a clear scaling law: as the synthetic data volume increases, performance on WebVoyager and Online-Mind2Web consistently improves.
Mila