Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study addresses the limitations of Phonetic Foundation Models (PFMs) in zero-shot phonetic classification by evaluating their performance on Chinese aspiration and Japanese moraic nasals, where traditional Grapheme-to-Phoneme (G2P) labels fail to provide phonetically faithful representations. The authors propose a novel classification method utilizing continuous Articulatory Feature (AF) vectors, which significantly improves accuracy, especially for rare phonetic elements. Key findings reveal that optimal temporal aggregation of AF vectors enhances classification performance, with single-frame methods excelling for aspiration and segmental approaches yielding better results for nasal sounds.
Continuous Articulatory Features can dramatically enhance zero-shot phonetic classification, outperforming traditional discrete token methods, especially for rare phonemes.
Recent Phonetic Foundation Models (PFMs) for Speech-to-IPA transcription rely on Grapheme-to-Phoneme (G2P) labels, but the phoneme labels are not necessarily phonetically faithful. To investigate this issue, we evaluate zero-shot phonetic classification on Chinese aspiration and Japanese moraic nasals. A PFM trained on G2P-labeled data excluding these two languages yields poor accuracy on both tasks, showing that multilingual coverage with discrete IPA tokens is not sufficient for unseen settings. To overcome this limitation, we propose a classification method based on continuous Articulatory Feature (AF) vectors extracted from each frame. This AF-based approach outperforms discrete token-based methods, particularly for rare phones. We further show that it is crucial to adopt the optimal temporal aggregation of AF vectors for the target distinction: single-frame classification is best for aspiration, while segmental classification substantially improves nasal classification.