AutoWebWorld: Synthesizing Infinite Verifiable Web Environments via Finite State Machines
This addresses the data bottleneck for training web agents, enabling scalable and verifiable synthetic data generation, though it is incremental as it builds on existing methods for environment synthesis.
The paper tackles the problem of expensive and hard-to-verify training data for autonomous Web GUI agents by proposing AutoWebWorld, a framework that synthesizes controllable web environments as Finite State Machines, generating over 11,663 verified trajectories at $0.04 each and boosting a 7B agent to outperform baselines on WebVoyager within 15 steps.
The performance of autonomous Web GUI agents heavily relies on the quality and quantity of their training data. However, a fundamental bottleneck persists: collecting interaction trajectories from real-world websites is expensive and difficult to verify. The underlying state transitions are hidden, leading to reliance on inconsistent and costly external verifiers to evaluate step-level correctness. To address this, we propose AutoWebWorld, a novel framework for synthesizing controllable and verifiable web environments by modeling them as Finite State Machines (FSMs) and use coding agents to translate FSMs into interactive websites. Unlike real websites, where state transitions are implicit, AutoWebWorld explicitly defines all states, actions, and transition rules. This enables programmatic verification: action correctness is checked against predefined rules, and task success is confirmed by reaching a goal state in the FSM graph. AutoWebWorld enables a fully automated search-and-verify pipeline, generating over 11,663 verified trajectories from 29 diverse web environments at only $0.04 per trajectory. Training on this synthetic data significantly boosts real-world performance. Our 7B Web GUI agent outperforms all baselines within 15 steps on WebVoyager. Furthermore, we observe a clear scaling law: as the synthetic data volume increases, performance on WebVoyager and Online-Mind2Web consistently improves.