Vidu S1: A Real-Time Interactive Video Generation Model
This work provides a practical solution for real-time, interactive video generation with voice control, addressing the need for personalized and responsive digital character animation.
Vidu S1 is a real-time interactive video generation model that enables voice-controlled digital character animation with infinite-length, blur-free video output at up to 42 FPS on consumer GPUs, achieving best performance across all test metrics.
We introduce Vidu S1, a real-time interactive video generation model supporting voice control of digital characters. Users can control video generation content at any moment through voice instructions. Vidu S1 supports infinite-length real-time video generation without blurring, drift, or visual distortion. Built with TurboDiffusion and TurboServe, Vidu S1 outputs 540p real-time videos at up to 42 FPS on regular consumer GPUs. Users can upload custom images of real people, anime, and pets, and choose different voice tones for personalized experiences. Experiments show that Vidu S1 achieves the best performance across all test metrics while fully meeting real-time inference requirements. A playable online demo is available at https://vidu.com/vidu-stream.