The Indispensable Role of User Simulation in the Pursuit of AGI
This addresses the challenge of advancing AGI through better evaluation and data acquisition, but it is incremental as it builds on existing simulation concepts.
The paper argues that user simulation is essential for overcoming bottlenecks in AGI development, such as evaluating interactive systems and generating training data, by providing scalable environments and fostering adaptive capabilities.
Progress toward Artificial General Intelligence (AGI) faces significant bottlenecks, particularly in rigorously evaluating complex interactive systems and acquiring the vast interaction data needed for training adaptive agents. This paper posits that user simulation -- creating computational agents that mimic human interaction with AI systems -- is not merely a useful tool, but is a critical catalyst required to overcome these bottlenecks and accelerate AGI development. We argue that realistic simulators provide the necessary environments for scalable evaluation, data generation for interactive learning, and fostering the adaptive capabilities central to AGI. Therefore, research into user simulation technology and intelligent task agents are deeply synergistic and must advance hand-in-hand. This article elaborates on the critical role of user simulation for AGI, explores the interdisciplinary nature of building realistic simulators, identifies key challenges including those posed by large language models, and proposes a future research agenda.