Search papers, labs, and topics across Lattice.
This paper introduces a lightweight framework for automated pronunciation assessment that leverages native speech resources without the need for extensive labeled learner data. By utilizing a K-means codebook for discretizing learner speech and a token language model to compute surprisal, the authors effectively identify phonotactic deviations. The integration of a transcript-guided Text2DUnit--DTW module enhances the model's performance, achieving a PCC improvement from 0.60 to 0.66 on SpeechOcean762, closely approaching supervised benchmarks and demonstrating robustness across datasets.
Achieving near-supervised performance in pronunciation assessment using only native speech resources could revolutionize how we evaluate language learners.
Training automated pronunciation assessment often relies on labeled learner errors or non-native corpora that are costly to collect. We propose a lightweight framework trained only on native speech resources, operating unsupervised or lightly calibrated with a small set of scored utterances. At inference, learner speech is discretized with an SSL encoder and a K-means codebook. A token language model trained on native sequences computes surprisal where higher surprisal indicates phonotactic deviation. We add a transcript-guided Text2DUnit--DTW module that predicts native token sequences from reference text and aligns them to acoustic tokens to derive error-sensitive features. Surprisal and alignment features are fused via simple regression. On SpeechOcean762, PCC improves from 0.60 to 0.66 with transcript guidance, near supervised baselines. Cross-dataset evaluation on L2-ARCTIC shows consistent gains.
