Search papers, labs, and topics across Lattice.
This study systematically evaluates the effectiveness of synthetic speech data for fine-tuning Automatic Speech Recognition (ASR) systems in Hindi, Kannada, and Telugu. By augmenting real-world recordings with synthetic data, the research reveals significant performance gains, while also exploring how variations in script sources and speech synthesis models impact ASR outcomes. Notably, the findings indicate that the number of distinct cloned voices used in synthetic speech generation plays a crucial role in enhancing ASR performance.
Incorporating synthetic speech data can lead to substantial performance improvements in ASR systems for Indic languages, but the choice of synthesis model and voice cloning strategy is critical.
Synthetic data has the potential to be a valuable resource for training machine learning models, particularly Automatic Speech Recognition (ASR) Systems; however, its effectiveness requires systematic evaluation. In this study, we investigate the impact of incorporating synthetic speech data alongside real-world recordings for three Indic languages: Hindi, Kannada, and Telugu. We analyze the performance gains achieved by augmenting synthetic data with real data and independently examine how ASR performance varies with the sources of scripts used to generate synthetic speech. In addition, we evaluate the effect of synthetic speech generated using different speech synthesis models. Finally, we study the impact of voice cloning in synthetic speech generation on ASR performance, including how performance varies with the number of distinct cloned voices used during data generation.
