Search papers, labs, and topics across Lattice.
This paper introduces a robust uncertainty modeling framework for speaker recognition that addresses the limitations of existing methods in accurately estimating and calibrating uncertainty under domain shifts. By implementing an Inter- and Intra-Speaker-Aware Uncertainty Softmax, the authors enhance the reliability of speaker embeddings by effectively capturing both inter-speaker separability and intra-speaker variability. Experimental results show significant improvements in uncertainty reliability and robustness in speaker recognition across various benchmarks, highlighting the effectiveness of the proposed Uncertainty-Calibrated Domain Adaptation (UCDA) framework.
Uncertainty estimates in speaker recognition can be dramatically improved by incorporating both inter- and intra-speaker dynamics, leading to more reliable embeddings.
Speaker embeddings aggregate frame-level acoustic features into compact representations for speaker recognition. Recent uncertainty-aware speaker modeling approaches further characterize the reliability of speaker embeddings by estimating their associated uncertainty. However, existing methods often suffer from inaccurate uncertainty estimation and uncertainty miscalibration under domain shifts. To address these challenges, we propose a robust uncertainty modeling framework from both estimation and adaptation perspectives. Specifically, we introduce an Inter- and Intra-Speaker-Aware Uncertainty Softmax that incorporates both inter-speaker separability and intra-speaker variability into uncertainty learning, enabling uncertainty estimates to better capture the reliability of speaker embeddings. Furthermore, we propose an Uncertainty-Calibrated Domain Adaptation (UCDA) framework to mitigate uncertainty miscalibration caused by domain mismatch. Extensive experiments on both in-domain and cross-domain benchmarks demonstrate that the proposed approach consistently improves uncertainty reliability and speaker recognition robustness.
