Search papers, labs, and topics across Lattice.
This study introduces a framework for learning robust room embeddings from reverberant speech that accounts for variations in speech content and recording quality, which typically degrade performance in downstream tasks. By anchoring embeddings to a structured room impulse response (RIR) latent space and employing a Kullback-Leibler (KL)-based alignment alongside a multi-positive contrastive term, the authors enhance the robustness of the embeddings. The proposed method includes a lightweight uncertainty calibration head that quantifies representation uncertainty, demonstrating effective selective prediction with only a single utterance during inference, even in the presence of various corruptions.
Room embeddings can now be reliably estimated from reverberant speech with a calibrated uncertainty score, enabling selective prediction from just one utterance.
Room embeddings derived from reverberant speech are often unreliable: speech content and recording degradation can alter the representation even when speaker, room, and source-receiver geometry remain unchanged, degrading downstream task performance. We propose a framework that learns room embeddings robust to speech-content variation and a representation-level uncertainty score from reverberant speech without downstream-task supervision. The embedding is anchored to a structured room impulse response (RIR) latent space and trained using a multi-view data structure with Kullback-Leibler (KL)-based alignment; a multi-positive contrastive term further refines robustness. A lightweight uncertainty head is calibrated using the dispersion of corruption-induced embeddings and optimized with a rank-based objective. Across waveform- and spectrogram-level corruptions, the score is consistent with representation dispersion and enables effective selective prediction while requiring only a single utterance at inference.
