Search papers, labs, and topics across Lattice.
This paper introduces SAMPA, a Whisper-based segmenter specifically designed for automatic prosodic boundary detection in Brazilian Portuguese, addressing a gap where traditional methods have dominated. By fine-tuning the Whisper large-v3 model on the NURC-SP dataset, the authors achieve competitive performance, with F1 scores of 0.731 on the held-out test split and 0.796 on the MuPe-Diversidades dataset. The model's effectiveness is further supported by n-gram and acoustic-visual analyses that demonstrate its reliance on morphosyntactic, semantic, and prosodic cues for boundary detection.
SAMPA achieves impressive F1 scores in prosodic boundary detection for Brazilian Portuguese, outperforming traditional methods and revealing the power of fine-tuned Whisper models in this domain.
Automatic prosodic segmentation identifies boundaries between speech units from acoustic and linguistic evidence. Although recent deep learning approaches have produced strong results for English, automatic segmentation for Brazilian Portuguese (BP) still relies mostly on rule-based or traditional machine-learning methods. This paper presents SAMPA, a Whisper-based segmenter that transcribes BP speech while inserting explicit markers for terminal prosodic boundaries. We fine-tune Whisper large-v3 on manually segmented recordings from the NURC-SP dataset and evaluate different training and test-time filtering configurations, including out-of-distribution testing on the MuPe-Diversidades dataset. SAMPA achieves competitive boundary-detection performance across settings, with the best models reaching F1=0.731 on the held-out test split and F1=0.796 on MuPe-Diversidades. Finally, through n-gram and acoustic-visual analyses, we show that our model follows morphosyntactic, semantic, and prosodic cues for detecting prosodic boundaries.
