Search papers, labs, and topics across Lattice.
This paper introduces a conditional flow-matching method for single-channel speech separation that effectively addresses source permutation ambiguity and sampling variability. By utilizing a frozen speaker encoder for source ordering and employing biometric best-of-$N$ candidate selection, the approach enhances chunk-level channel alignment during inference. Evaluations on the Libri2Mix benchmark reveal that the proposed Transformer U-Net variant not only matches strong baselines in separation quality metrics but also significantly reduces error rates in downstream tasks like automatic speech recognition and speaker verification.
Achieving the lowest error rates in automatic speech recognition and speaker verification, this method redefines the standards for single-channel speech separation.
Single-channel speech separation remains challenging for real-world deployment due to source permutation ambiguity, sampling variability of generative models, and the difficulty of processing long recordings with chunk-wise inference. We address these issues with a conditional flow-matching-based method that produces an ordered two-source output conditioned on the mixture. A frozen speaker encoder defines the source order during training and is reused at inference for biometric best-of-$N$ candidate selection and chunk-level channel alignment. We evaluate separation quality on Libri2Mix benchmark using SI-SDR, PESQ, and ESTOI, and measure downstream impact using cpWER for automatic speech recognition and EER for speaker verification. The results show that the proposed Transformer U-Net variant is competitive with strong baselines in objective separation metrics and achieves the lowest downstream automatic speech recognition and speaker verification error rates in all evaluated settings.
