Search papers, labs, and topics across Lattice.
This paper generates a comprehensive acoustic landmark database for the English lexicon by synthesizing speech from articulatory gestures using the Pink Trombone synthesizer. The dataset includes over 200,000 synthesized words with precise time-aligned annotations, allowing for detailed analysis of landmark frequencies and cue patterns across different speaker configurations. The findings facilitate quantitative studies and provide a valuable resource for training and benchmarking automatic landmark detection systems, addressing the limitations posed by the lack of large annotated datasets in this field.
Over 200,000 synthesized words reveal the intricate relationship between articulatory gestures and acoustic landmarks in speech.
Acoustic landmark theory treats speech as organized around the acoustic consequences of articulatory gestures that shape the vocal tract and airflow. Progress is limited by the scarcity of large, unambiguously annotated landmark datasets. We invert the problem by generating speech from landmark patterns. Using the Pink Trombone physical vocal-tract synthesizer, we produce an English lexicon for two adult configurations (male, female). With direct control of gestures, we place landmark labels algorithmically at the exact times of their physical events (e.g., oral closures/releases). The corpus contains $>$200,000 synthesized words, rendered for both configurations with time-aligned annotations; intelligibility is measured with STOI. We leverage it for statistics across the lexicon from an articulatory-event view, reporting landmark frequencies and dominant cue patterns, and enabling quantitative studies plus training/benchmarking of automatic landmark detectors.
MIT CSAIL