Search papers, labs, and topics across Lattice.
This study introduces a novel application of physics-informed neural operators (PINOs) for analyzing speech production by directly learning the governing one-dimensional wave equations without the need for pre-computed supervised training data. The proposed model utilizes vocal tract shape data to predict key speech parameters, achieving remarkable accuracy with errors of only 0.8% for glottal volume flow and 3.2% for speech waveforms compared to traditional numerical methods. The findings highlight the efficiency of the PINO approach, enabling GPU-parallelized simulations that significantly reduce computational time in speech analysis.
Achieving 0.8% error in glottal volume flow, this PINO-based method revolutionizes speech production analysis by eliminating the need for pre-computed training data.
Physics-informed neural operators (PINOs) have recently gained attention as fast numerical simulators with potential for solving inverse problems. This study proposes the first PINO-based method for speech production analysis. The model learns the governing one-dimensional wave equations directly without requiring pre-computed supervised training data. Using vocal tract shape data as input features, we compare the proposed model's predicted f0, glottal volume velocity and sound pressure at the lip for five static vowels to a conventional Runge Kutta/Finite difference approach. With errors of 0.8% for glottal volume flow and 3.2% for speech waveforms, the proposed model enables efficient GPU-parallelized simulation without iterative calculations. We conclude that PINO is a promising approach for fast analysis of speech.
