BotDirector: Robot Storytelling Across the Symmetrical Reality with Multi-modal Interactions
This work addresses the complexity of robot storytelling for young children by providing a tangible and interactive system, though it is an incremental application of existing technologies (LLMs, swarm robots) to a specific domain.
BotDirector enables children to create robot storytelling scenarios using everyday objects and natural language, with an LLM agent transforming narratives into motion sequences executed by swarm robots.
Robot storytelling offers a unique blend of technological innovation and creative expression that engages children in unprecedented ways. However, the technical aspects are often too complicated for children. We propose an interactive system that facilitates robot storytelling with tangible and natural language interactions. Children arrange the playground with their own stuff and create narratives with an LLM agent. The created narratives are transformed into a motion sequence based on the map and characters, and the motions are executed by self-navigating swarm robots. This system enhances robot storytelling with flexible scenarios, enabling young children to create robot dramas with everyday objects.