From Script to Stage: Automating Experimental Design for Social Simulations with LLMs
For social scientists, FSTS reduces the need for interdisciplinary expertise in designing LLM-based simulations, but the novelty is incremental as it applies existing LLM agents to a structured pipeline.
FSTS automates multi-agent experiment design for social simulations using LLMs, decomposing the process into script composition, finalization, and actor generation. Tests show it reproduces real-world results, lowering technical barriers for social science research.
Multi-agent simulation based on LLMs has increasingly emerged as a new paradigm for exploring complex social phenomena and validating theoretical hypotheses. However, traditional experimental design in the social sciences relies heavily on interdisciplinary expert knowledge, involving cumbersome procedures and high technical barriers. While LLM-driven agents demonstrate broad prospects for designing experiments, their limitations regarding reliability and scientific rigor continue to significantly hinder their in-depth application in social science research. To address these challenges, this paper proposes FSTS, an automated framework for multi-agent experiment design based on script generation. Drawing on the concept of the "Decision Theater," the framework deconstructs experimental design into three core phases: Script Composition, Script Finalization, and Actor Generation. Tests across multiple scenarios indicate that the agents generated by this framework can enact the script within the "experimental theater", reproducing results consistent with real-world situations. The proposal of FSTS not only effectively lowers the barrier for social science experimental design but also provides scientifically grounded decision support for policy-making.