Search papers, labs, and topics across Lattice.
This study employs canonical correlation analysis to explore the interpretability of a Wav2Vec 2.0-based speech intelligibility assessment model specifically for oral and oropharyngeal cancer patients. By correlating model embeddings with eGeMAPS low-level descriptors, the authors reveal that the model's learned representations are predominantly aligned with spectral and prosodic features, with the first MFCC coefficient showing the strongest correlations. The findings not only enhance understanding of the model's acoustic information encoding but also provide actionable insights for selecting relevant acoustic features in pathological speech assessment.
The model's learned representations reveal a surprising dominance of spectral and prosodic features, reshaping our understanding of acoustic encoding in pathological speech assessment.
This work investigates the interpretability of a Wav2Vec 2.0based speech intelligibility assessment model for oral and oropharyngeal cancer patients through canonical correlation analysis. By measuring the correlation between the model embeddings and eGeMAPS low-level descriptors (LLDs) as an interpretable reference, we analyze how acoustic information is encoded across the model layers. The analysis is conducted at two levels: individual LLDs layer-wise, and group-level: prosodic, spectral, and voice quality. Results show that the learned representations are most strongly correlated with spectral and prosodic features, with the first MFCC coefficient yielding the highest correlations across all layers. At the group level, spectral and prosodic groups achieve correlations of 0.77 and 0.71 respectively, while voice quality reaches 0.65. Beyond model interpretability, this work also offers practical guidance on acoustic feature selection for pathological speech assessment.
