Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces AtlasOCR, the first open-source OCR model for Darija, a Moroccan Arabic dialect, by fine-tuning a 3B Qwen2.5-VL model. A novel Darija-specific dataset was created using synthetic data generation via OCRSmith and real-world data sourcing. The model was trained using QLoRA and Unsloth for parameter-efficient fine-tuning, achieving state-of-the-art results on AtlasOCRBench and KITAB-Bench, even surpassing larger models.
A 3B parameter model can outperform larger models in a low-resource language OCR task, demonstrating the power of targeted data curation and efficient fine-tuning.
Darija, the Moroccan Arabic dialect, is rich in visual content yet lacks specialized Optical Character Recognition (OCR) tools. This paper introduces AtlasOCR, the first open-source Darija OCR model built by fine-tuning a 3B parameter Vision Language Model (VLM). We detail our comprehensive approach, from curating a unique Darija-specific dataset leveraging both synthetic generation with our OCRSmith library and carefully sourced real-world data, to implementing efficient fine-tuning strategies. We utilize QLoRA and Unsloth for parameter-efficient training of Qwen2.5-VL 3B and present comprehensive ablation studies optimizing key hyperparameters. Our evaluation on the newly curated AtlasOCRBench and the established KITAB-Bench demonstrates state-of-the-art performance, challenging larger models and highlighting AtlasOCR's robustness and generalization capabilities for both Darija and standard Arabic OCR tasks.