Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces an iterative pseudo-labeling approach to improve automatic speech recognition (ASR) for Mandarin-English code-switching, a challenging task due to the scarcity of labeled training data. By leveraging a large unlabeled corpus, the method generates pseudo-labels that create a semi-supervised dataset, which is then utilized in a two-stage bilingual model training process followed by iterative refinements. The results show significant reductions in Mix Error Rate (MER) on the SEAME dataset, highlighting the effectiveness of this approach in enhancing CS-ASR performance.
Iterative pseudo-labeling can dramatically reduce Mix Error Rates in Mandarin-English code-switching ASR, achieving up to 8.29% improvement on challenging datasets.
Code-switching (CS), alternating languages within the same utterance, poses significant challenges for automatic speech recognition (ASR) due to limited CS training data. This paper applies an iterative pseudo-labeling training approach to CS-ASR for the first time, demonstrating its effectiveness in leveraging unlabeled data to improve CS-ASR performance. The approach comprises three phases: pseudo-label generation, two-stage bilingual model training, and iterative improvements. It begins by generating pseudo-labels from a large unlabeled corpus, creating a semi-supervised dataset. This dataset supports a two-stage training framework where the model is pre-trained and then fine-tuned on supervised CS data. Iterative refinements further enhance the model's accuracy in handling complex CS scenarios. Our approach significantly advances CS-ASR systems, achieving notable Mix Error Rate (MER) reductions on SEAME's devman (6.35%) and devsge (8.29%) subsets.