Search papers, labs, and topics across Lattice.
The paper introduces NileTTS, a 38-hour Egyptian Arabic speech dataset created using a novel synthetic data pipeline that leverages LLMs for text generation followed by audio synthesis and automatic transcription. This addresses the significant lack of resources for Egyptian Arabic TTS compared to MSA and Gulf dialects. Fine-tuning XTTS v2 on NileTTS demonstrates improved performance over a baseline model trained on other Arabic dialects, showcasing the effectiveness of the synthetic data pipeline.
Unlock high-quality Egyptian Arabic text-to-speech with NileTTS, a new 38-hour dataset created using a clever LLM-powered synthetic data pipeline.
Despite the advances in neural text to speech (TTS), many Arabic dialectal varieties remain marginally addressed, with most resources concentrated on Modern Spoken Arabic (MSA) and Gulf dialects, leaving Egyptian Arabic -- the most widely understood Arabic dialect -- severely under-resourced. We address this gap by introducing NileTTS: 38 hours of transcribed speech from two speakers across diverse domains including medical, sales, and general conversations. We construct this dataset using a novel synthetic pipeline: large language models (LLM) generate Egyptian Arabic content, which is then converted to natural speech using audio synthesis tools, followed by automatic transcription and speaker diarization with manual quality verification. We fine-tune XTTS v2, a state-of-the-art multilingual TTS model, on our dataset and evaluate against the baseline model trained on other Arabic dialects. Our contributions include: (1) the first publicly available Egyptian Arabic TTS dataset, (2) a reproducible synthetic data generation pipeline for dialectal TTS, and (3) an open-source fine-tuned model. All resources are released to advance Egyptian Arabic speech synthesis research.
