Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study investigates the phonetic representations of a self-supervised speech model applied to Mandarin sub-dialects through an innovative, unlabeled probing approach. By utilizing a language-agnostic universal phone recognizer, the authors reveal that while certain articulatory features like labiality and stridency are stable across dialects, finer spectral distinctions show significant variability, particularly with Beijing Mandarin exhibiting higher decodability. The findings highlight the uneven sensitivity of self-supervised models to dialectal variations, suggesting implications for their deployment in diverse linguistic contexts.
Dialect sensitivity in self-supervised speech models is uneven, with Beijing Mandarin revealing strikingly higher decodability for certain features.
While self-supervised speech models have achieved strong performance across speech tasks, relatively little is known about how their internal phonetic representations behave under fine-grained dialect variation. Existing probing studies typically rely on curated corpora with manual phonetic annotations, limiting their applicability to naturally occurring dialect speech. We present a case study of articulatory feature representations in a Mandarin self-supervised speech model using an entirely unlabeled probing pipeline. Phone sequences are generated using a language-agnostic universal phone recognizer and mapped to articulatory feature vectors, enabling frame-level probing without manual annotation. Our results reveal a structured pattern in articulatory feature decodability across Mandarin sub-dialects. Acoustically salient features such as labiality and stridency remain comparatively stable, whereas features associated with finer spectral distinctions exhibit larger dialect-dependent variation. This variation is driven primarily by elevated decodability for Beijing speech relative to other Mandarin sub-dialects. Layer-wise analyses further show distinct representational dynamics for these feature groups. These findings suggest that language-agnostic articulatory probing can be applied to real-world dialect corpora and that dialect sensitivity in self-supervised speech representations is unevenly distributed across articulatory dimensions.