Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper details a cascaded diarization-then-recognition system developed for the 2nd MLCSLM Challenge, utilizing DiariZen-Large-s80 for segmentation, CAM++ for two-speaker clustering, and a LoRA-adapted omniASR LLM 7B v2 for recognition without relying on oracle segmentation or speaker labels. The system achieved a macro tcpMER of 29.27% on the Development set and 50.23% on the Evaluation set, significantly outperforming the official baseline of 79.15%. Key engineering insights reveal that embedding-based speaker clustering enhances performance over end-to-end alternatives and that overlap-aware segmentation, while aimed at improving recall, inadvertently reduces tcpMER due to duplicated transcriptions of overlapping speech.
Embedding-based speaker clustering can dramatically improve performance in speech recognition systems, even as overlap-aware segmentation introduces unexpected challenges.
We describe our submission to Task 1 of the 2nd MLCSLM Challenge: a cascaded diarization-then-recognition system that combines DiariZen-Large-s80 (WavLM-Large) segmentation, CAM++ embedding-based two-speaker clustering, and a LoRA-adapted omniASR LLM 7B v2 recognizer, with no oracle segmentation or speaker labels at test time. On the official Development set (150 conversations, 21 language/accent categories) the system attains a macro tcpMER of 29.27%, versus 79.15% for the official baseline; on the Evaluation set it scores 50.23%. We also analyze two engineering choices that substantially affect tcpMER. First, embedding-based speaker clustering outperforms an end-to-end-style alternative that assigns speakers from ASRturn markers alone. Second, overlap-aware segmentation, although intended to raise diarization recall, increases tcpMER because overlapped speech is transcribed twice.