Search papers, labs, and topics across Lattice.
The authors introduce DuplexChat, an open-source corpus designed for training full-duplex spoken dialogue models, addressing the lack of suitable monaural datasets. Utilizing DuplexChat-Pipe, they construct a large-scale, speaker-separated dialogue dataset from public podcast feeds, achieving a total of 282,634 hours of English and 132,723 hours of Japanese audio. Analysis reveals that DuplexChat effectively captures the turn-taking dynamics characteristic of human conversations, making it a valuable resource for advancing spoken dialogue language modeling.
DuplexChat offers over 400,000 hours of speaker-separated dialogue, transforming the landscape for training full-duplex spoken dialogue models.
Full-duplex spoken dialogue models are trained on conversational speech in which each speaker is represented as a separate stream, but existing large-scale public speech corpora are mostly monaural, making them unsuited for SDLM training. We present DuplexChat, an open-source corpus for full-duplex spoken dialogue models, and DuplexChat-Pipe, a pipeline for constructing speaker-separated full-duplex dialogue speech from public podcast feeds. DuplexChat-Pipe filters language-specific podcast feeds, retrieves and cleans episode audio, extracts diarization-guided two-speaker dialogue clips, and applies speech separation and restoration to produce one channel per speaker. Running this pipeline yields a speaker-separated spoken dialogue corpus covering 282,634 hours of English and 132,723 hours of Japanese. Analysis results on DuplexChat show that it contains turn-taking dynamics present in human dialogues.