Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a joint training strategy for unsupervised domain adaptation in speech recognition, simultaneously updating both the ensemble of teacher models and the student model. This eliminates the need for sequential training and allows for mutual improvement between teacher and student. Experiments on adapting from AMI, WSJ, and LS360 to Switchboard show a 4.6% WER improvement over multi-stage and iterative training methods.
Jointly training teacher and student models slashes word error rates in unsupervised speech recognition adaptation by enabling mutual improvement.
Speech recognition systems often struggle with data domains that have not been included in the training. To address this, unsupervised domain adaptation has been explored with ensemble and multi-stage teacher-student training methods reducing the word error rate. Despite improvements, the error rate remains much higher than that achieved with supervised in-domain training. This work proposes a more efficient strategy by simultaneously updating the ensemble of teacher models along with the single student model eliminating the need for sequential models training. The joint update improves the word error rate of the student model, benefiting the progressively enhanced teacher models. Experiments are conducted with three labelled source datasets, namely AMI, WSJ, LS360, and one unlabeled target domain i.e. SwitchBoard. The results show that the proposed method improves the WER by 4.6% on the Switchboard eval00 test set, thus outperforming multi-stage and iterative training methods.