Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study enhances the assessment of dysarthric speech by integrating human-annotated Mean Opinion Score (MOS) data from speech synthesis evaluations, addressing the challenge of limited clinically annotated dysarthric speech. The researchers found that fine-tuning models on this synthetic data significantly improved predictions of both intelligibility and naturalness, with joint training yielding even greater benefits for naturalness. These findings indicate that perceptual similarities between synthesis artifacts and dysarthric speech can be leveraged to improve assessment tools, potentially transforming speech therapy practices.
Fine-tuning on speech synthesis data boosts dysarthric speech assessment performance, revealing a surprising synergy between synthetic and disordered speech.
Dysarthria is a speech disorder marked by reduced intelligibility and communicative effectiveness. Automatic utterance-level assessment of dysarthric speech can support scalable speech monitoring and therapy-related analysis. Yet training such systems is bottlenecked by the scarcity of clinically annotated dysarthric speech. This work proposes to augment dysarthric speech assessment using data from speech synthesis evaluations, specifically human-annotated utterances with Mean Opinion Score (MOS) labels from the QualiSpeech corpus. Experiments show that fine-tuning on speech synthesis assessment data consistently improves performance on both intelligibility and naturalness prediction, while joint training yields gains primarily on naturalness. These results suggest that synthesis artifacts and dysarthric speech share perceptual commonalities, and speech synthesis evaluation corpora offer a practical augmentation source that reduces reliance on scarce clinical annotations.
Tsinghua AI