Search papers, labs, and topics across Lattice.
This paper investigates acoustic-to-articulatory inversion using clean speech as an alternative to denoised speech recorded during real-time MRI (rt-MRI). The authors trained a model on denoised MRI speech and evaluated it on both denoised MRI speech and clean speech, using phonetic segmentation to align the signals. Results demonstrate that clean speech can be used effectively for articulatory inversion, achieving a root mean squared error (RMSE) of 1.56 mm, comparable to MRI-based performance.
You can reconstruct vocal tract shapes from clean speech almost as well as from noisy MRI recordings, opening the door to more practical articulatory analysis.
Articulatory acoustic inversion reconstructs vocal tract shapes from speech. Real-time magnetic resonance imaging (rt-MRI) allows simultaneous acquisition of both the acoustic speech signal and articulatory information. Besides the complexity of rt-MRI acquisition, the recorded audio is heavily corrupted by scanner noise and requires denoising to be usable. For practical use, it must be possible to invert speech recorded without MRI noise. In this study, we investigate the use of speech recorded in a clean acoustic environment as an alternative to denoised MRI speech. To this end we compare two signals from the same speaker with identical sentences which are aligned using phonetic segmentation. A model trained on denoised MRI speech is evaluated on both denoised MRI and clean speech. We also assess a model trained and tested only on clean speech. Results show that clean speech supports articulatory inversion effectively, achieving an RMSE of 1.56 mm, close to MRI-based performance.
