Search papers, labs, and topics across Lattice.
Vidu S1 is a cutting-edge real-time interactive video generation model that allows users to control video content through voice commands, enabling a highly personalized experience. Leveraging TurboDiffusion and TurboServe, it generates high-quality 540p videos at up to 42 FPS on standard consumer GPUs, maintaining visual fidelity without blurring or distortion. Experimental results indicate that Vidu S1 outperforms existing models across all tested metrics while satisfying real-time inference constraints, making it a significant advancement in interactive media technology.
Users can now generate and control high-quality videos in real-time using just their voice, revolutionizing interactive content creation.
We introduce Vidu S1, a real-time interactive video generation model supporting voice control of digital characters. Users can control video generation content at any moment through voice instructions. Vidu S1 supports infinite-length real-time video generation without blurring, drift, or visual distortion. Built with TurboDiffusion and TurboServe, Vidu S1 outputs 540p real-time videos at up to 42 FPS on regular consumer GPUs. Users can upload custom images of real people, anime, and pets, and choose different voice tones for personalized experiences. Experiments show that Vidu S1 achieves the best performance across all test metrics while fully meeting real-time inference requirements. A playable online demo is available at https://vidu.com/vidu-stream.
Tsinghua AI