StageDesigner: Artistic Stage Generation for Scenography via Theater Scripts
This addresses the need for automated stage design in theater, offering a novel application but is incremental in combining existing AI techniques for a specific domain.
The paper tackles the problem of generating artistic 3D stage scenes for scenography by introducing StageDesigner, a framework that uses large language models and layout-controlled diffusion models to simulate artist workflows, resulting in effective performance as demonstrated by evaluations and user studies.
In this work, we introduce StageDesigner, the first comprehensive framework for artistic stage generation using large language models combined with layout-controlled diffusion models. Given the professional requirements of stage scenography, StageDesigner simulates the workflows of seasoned artists to generate immersive 3D stage scenes. Specifically, our approach is divided into three primary modules: Script Analysis, which extracts thematic and spatial cues from input scripts; Foreground Generation, which constructs and arranges essential 3D objects; and Background Generation, which produces a harmonious background aligned with the narrative atmosphere and maintains spatial coherence by managing occlusions between foreground and background elements. Furthermore, we introduce the StagePro-V1 dataset, a dedicated dataset with 276 unique stage scenes spanning different historical styles and annotated with scripts, images, and detailed 3D layouts, specifically tailored for this task. Finally, evaluations using both standard and newly proposed metrics, along with extensive user studies, demonstrate the effectiveness of StageDesigner. Project can be found at: https://deadsmither5.github.io/2025/01/03/StageDesigner/