Wen Wang

Finally, you can puppeteer both the sights and sounds of AI-generated characters, controlling their identity, voice, pose, and scene with unprecedented precision.

Fine-grained reward signals for semantic quality and interaction timing unlock more human-like spoken dialogue models.

Reinforcement learning can now be practically applied to spoken dialogue models thanks to a new post-training recipe that disentangles semantic and acoustic improvements.