Search papers, labs, and topics across Lattice.
This paper investigates personalized federated learning strategies for automatic speech recognition (ASR) tailored to dysarthric speakers, addressing the challenges posed by speaker variability in traditional models. By implementing two aggregation strategies鈥攑arameter-based and embedding-based averaging鈥攖he authors demonstrate significant improvements in word error rates (WER) compared to the baseline regularized FedAvg. The findings reveal that personalized approaches can effectively enhance ASR performance for dysarthric speech, achieving reductions of up to 0.99% absolute on UASpeech and 0.56% absolute on TORGO datasets.
Personalized federated learning can reduce word error rates in dysarthric speech recognition by up to 0.99%, highlighting the potential for tailored ASR solutions.
Speech recognition is challenging for dysarthric speakers. While federated learning (FL)-based ASR can be an effective tool for protecting privacy, it suffers from heterogeneity issues caused by speaker variability. Forcing all speakers to share the same model components can be suboptimal under such heterogeneity, making personalization a promising direction; however, related research on dysarthric speech remains limited. To this end, this paper explores two aggregation strategies to achieve personalization, including the parameter-based averaging strategy and the embedding-based averaging strategy. Experiments on UASpeech and TORGO show that the proposed methods outperform the baseline regularized FedAvg by statistically significant WER reductions of up to 0.99% absolute (3.15% relative) on UASpeech and 0.56% absolute (4.73% relative) on TORGO, respectively.
