Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces DASH, a self-distillation framework designed to enhance the robustness of Automatic Speech Recognition (ASR) systems in noisy environments by leveraging clean-noisy consistency from paired views. By distilling hidden representations across multiple encoder layers, DASH effectively captures a range of features from low-level acoustics to high-level semantics, while minimizing the KL divergence between clean and noisy prototype distributions. Experiments on the LibriSpeech dataset demonstrate that DASH significantly improves recognition performance in various noisy conditions without sacrificing accuracy in clean scenarios, requiring only a minimal increase in fine-tuning time.
DASH achieves robust speech recognition in noisy environments without compromising clean accuracy, all while adding just 4% to fine-tuning time.
Automatic Speech Recognition (ASR) often degrades in real-world noisy environments, making noise robustness essential for deployment. Supervised noise-augmented fine-tuning is a common remedy, but it can introduce a robustness-clean trade-off and overfit to specific corruptions, degrading recognition in clean conditions. We propose DASH, a self-distillation framework that improves robustness by learning clean--noisy consistency from paired views. DASH distills hidden representations from multiple encoder layers to capture features from low-level acoustics to high-level semantics, and stabilizes training by minimizing KL divergence between prototype assignment distributions of clean and noisy views. Experiments on LibriSpeech show that DASH consistently improves recognition under diverse noisy conditions while preserving clean accuracy, achieved by a label-free pre-training stage with minimal additional overhead (about 4% of fine-tuning time) beyond standard fine-tuning.