Search papers, labs, and topics across Lattice.
This study constructs a high-quality 28-hour Burmese medical speech corpus and fine-tunes Whisper models to improve automatic speech recognition (ASR) for clinical dialogue in Burmese. The research highlights the effectiveness of both full fine-tuning (FFT) and parameter-efficient fine-tuning (PEFT) with LoRA, demonstrating that while data augmentation can hinder performance on clean speech, it enhances robustness in noisy environments. The best-performing model, myMediWhisper-Medium, achieves a state-of-the-art Word Error Rate (WER) of 23.44%, surpassing larger general-domain models.
Achieving a WER of 23.44% for Burmese medical ASR, this work sets a new benchmark that challenges the capabilities of larger models.
Although Whisper models benefit from large-scale multilingual pre-training, their performance on Burmese medical speech remains limited. This work presents a Burmese medical speech recognition framework built on a high-quality 28-hour corpus recorded and validated by native speakers. We fine-tune Whisper models using full fine-tuning (FFT) and parameter-efficient fine-tuning (PEFT) with LoRA. To evaluate robustness, we apply waveform- and spectrogram-level data augmentation under controlled noise and simulated room acoustics. While augmentation reduces performance on clean speech, it significantly improves robustness in noisy and reverberant environments across FFT and PEFT settings. Our best-performing system, fully fine-tuned myMediWhisper-Medium without augmentation, achieves a state-of-the-art Word Error Rate (WER) of 23.44%, outperforming much larger general-domain fine-tuned models. Dataset and other resources can be found at the Huggingface repository: https://huggingface.co/datasets/LULab/mediTalk-mm-rdy.
