Search papers, labs, and topics across Lattice.
Shanghai Jiao Tong University
3
0
4
HoliDubber revolutionizes video dubbing by seamlessly integrating speech and sound effects from a single text prompt, outperforming traditional methods in quality and synchronization.
Current audio editing models are failing spectacularly, with an Exact Match Rate below 5% in complex tasks, exposing a critical need for improvement.
Online reinforcement learning with large audio language model rewards catapults text-to-audio generation to a new state-of-the-art, even with a relatively small 470M parameter model.