Search papers, labs, and topics across Lattice.
This paper introduces PASQA, a novel model for assessing speech quality with a focus on pitch-accent correctness, addressing a gap in traditional mean opinion score (MOS) models that overlook localized accent errors. By creating a controlled dataset of Japanese accent errors and employing advanced techniques such as self-supervised representations and mora-conditioned fusion, PASQA achieves superior accuracy in ranking accent-error severity compared to conventional models. The results demonstrate that PASQA aligns more closely with human judgments of accent correctness, indicating its potential for improving speech assessment in diverse applications.
Conventional speech quality models miss critical pitch-accent errors, but PASQA accurately ranks accent severity and aligns with human judgments.
Existing mean opinion score (MOS) prediction models typically predict utterance-level naturalness MOS and can be insensitive to localized pitch-accent errors. We propose Pitch-Accent-focused Speech Quality Assessment (PASQA), which explicitly targets pitch-accent correctness. To train our model, we construct a controlled Japanese accent-error dataset by changing accent patterns using an accent-controllable text-to-speech system, and compute a pseudo accent-quality score from the accent-error rate. PASQA builds on self-supervised representations and employs mora-conditioned fusion, ranking loss, an auxiliary accent-error localization task, and speaker-invariant training. Experiments show that conventional models fail to preserve the ordering by accent-error severity, whereas PASQA achieves high ordering accuracy on both seen and unseen speakers. Further, PASQA shows stronger agreement with human accent-correctness judgments. The code is available at https://github.com/lycorp-jp/PASQA.
