Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study investigates the effectiveness of Grapheme-to-Phoneme (G2P) models in enhancing automatic phonetic transcription when combined with varying levels of human supervision. The researchers found that G2P supervision is beneficial only when the amount of human annotation is limited to 20-30 hours, beyond which it does not improve performance and may even hinder cross-dialect robustness. Instead, they highlight the importance of ASR pretraining, achieving a 2.3x reduction in weighted phone feature error rate, particularly benefiting non-native and aphasic speech recognition.
G2P models can backfire in phonetic transcription when human supervision exceeds 30 hours, revealing a critical threshold for effective scaling.
Expert phonetic annotation is costly, especially for non-standard dialects and atypical speech. A common alternative is using Grapheme-to-Phoneme (G2P) models to auto-generate phonetic labels from text transcripts at scale. We study how automatic phonetic transcription performance scales with human and G2P supervision in English. Using a curated 80-hour benchmark spanning native, non-native and post-stroke speech, we identify a supervision quality threshold: G2P supervision helps only when fewer than 20-30 hours of human annotation are available. Beyond this threshold, it provides no significant benefit and can reduce cross-dialect robustness. What is effective after this threshold is ASR pretraining which we use to achieve a 2.3x reduction in weighted phone feature error rate over prior systems, with strong gains on non-native and aphasic speech. These results suggest that quantity-driven G2P scaling may yield diminishing returns for robust generalization.