Search papers, labs, and topics across Lattice.
The AURORA model is introduced to predict tongue displacement and shape from vowel formants, leveraging ultrasound tongue imaging and acoustic data from 40 English speakers. It aims to bridge the gap between acoustic phonetics and articulatory understanding, offering a tool for both education and clinical biofeedback. Qualitative evaluation demonstrates the model's ability to capture key tongue features, and its accessibility is enhanced through a Shiny app and real-time biofeedback prototype.
Imagine seeing your tongue move in real-time based on the sounds you make – AURORA brings that closer to reality.
This paper outlines the conceptual and computational foundations of the AURORA (Acoustic Understanding and Real-time Observation of Resonant Articulations) model. AURORA predicts tongue displacement and shape in vowel sounds based on the first two formant values. It is intended as a didactic aid helping to explain the relationship between formants and the underlying articulation, as well as a foundation for biofeedback applications. The model is informed by ultrasound tongue imaging and acoustic data from 40 native speakers of English. In this paper we discuss the motivation for the model, the modelling objectives as well as the model architecture. We provide a qualitative evaluation of the model, focusing on selected tongue features. We then present two tools developed to make the model more accessible to a wider audience, a Shiny app and a prototype software for real-time tongue biofeedback. Potential users include students of phonetics, linguists in fields adjacent to phonetics, as well as speech and language therapy practitioners and clients.