Search papers, labs, and topics across Lattice.
This paper tackles the challenge of producing tight boundary predictions in speaker diarization despite training on loosely annotated multi-talker conversational data. By employing a novel approach that generates tighter pseudo labels through causal and anticausal models, the authors create a co-training scheme that iteratively refines these labels for improved model performance. The results indicate that their method recovers approximately 70% of the effectiveness of training with ideal tight labels, significantly enhancing downstream applications.
Achieving 70% of the benefits of ideal tight-label training, this method transforms how speaker diarization models handle loose annotations.
Multi-talker conversational automatic speech recognition data are often used to train speaker diarization models. Because such data prioritize semantic continuity, pauses and boundary margins are included within speech segments, resulting in loose annotations. Models trained on such data tend to internalize mechanisms that reproduce this looseness, although tight speech intervals are sometimes preferable for downstream applications. In this paper, we address the novel task of enabling models to produce tight predictions using loose labels. Our method generates tighter pseudo labels using causal and anticausal models, which are inherently incapable of learning loosening behavior. We further propose a co-training scheme that iteratively tightens labels and updates both models for more progressive refinement. Experimental results show that the proposed method recovers about 70 % of the tightening effect achieved by ideal tight-label training and improves downstream performance.
