Vidmento: Creating Video Stories Through Context-Aware Expansion With Generative Video
This addresses the challenge for video creators who face limitations in material, offering a practical tool for hybrid storytelling, though it is incremental as it builds on existing filmmaking principles and generative video techniques.
The paper tackled the problem of video storytelling being constrained by available material by developing Vidmento, a tool that uses generative video for context-aware expansion, enabling creators to fill narrative gaps and enhance creative expression, as validated in a study with 12 creators.
Video storytelling is often constrained by available material, limiting creative expression and leaving undesired narrative gaps. Generative video offers a new way to address these limitations by augmenting captured media with tailored visuals. To explore this potential, we interviewed eight video creators to identify opportunities and challenges in integrating generative video into their workflows. Building on these insights and established filmmaking principles, we developed Vidmento, a tool for authoring hybrid video stories that combine captured and generated media through context-aware expansion. Vidmento surfaces opportunities for story development, generates clips that blend stylistically and narratively with surrounding media, and provides controls for refinement. In a study with 12 creators, Vidmento supported narrative development and exploration by systematically expanding initial materials with generative media, enabling expressive video storytelling aligned with creative intent. We highlight how creators bridge story gaps with generative content and where they find this blending capability most valuable.