Search papers, labs, and topics across Lattice.
The paper investigates two training strategies for multilingual OCR systems using Vision-Language Models (VLMs) from the Chitrapathak series, comparing end-to-end training with fine-tuning an existing OCR model. The study finds that fine-tuning an existing OCR model achieves better accuracy-latency trade-offs, leading to Chitrapathak-2 which achieves state-of-the-art performance in Telugu and significant speedups. Additionally, the authors introduce Parichay, an OCR model series tailored for Indian government documents, demonstrating high accuracy in extracting structured key fields.
Fine-tuning an existing OCR model, even if not pre-trained on target languages, surprisingly beats end-to-end training for production-scale multilingual OCR in the Indian context, offering a sweet spot of accuracy and speed.
Designing Optical Character Recognition (OCR) systems for India requires balancing linguistic diversity, document heterogeneity, and deployment constraints. In this paper, we study two training strategies for building multilingual OCR systems with Vision-Language Models through the Chitrapathak series. We first follow a popular multimodal approach, pairing a generic vision encoder with a strong multilingual language model and training the system end-to-end for OCR. Alternatively, we explore fine-tuning an existing OCR model, despite not being trained for the target languages. Through extensive evaluation on multilingual Indic OCR benchmarks and deployment-oriented metrics, we find that the second strategy consistently achieves better accuracy-latency trade-offs. Chitrapathak-2 achieves 3-6x speedup over its predecessor with being state-of-the-art (SOTA) in Telugu (6.69 char ANLS) and second best in the rest. In addition, we present Parichay, an independent OCR model series designed specifically for 9 Indian government documents to extract structured key fields, achieving 89.8% Exact Match score with a faster inference. Together, these systems achieve SOTA performance and provide practical guidance for building production-scale OCR pipelines in the Indian context.
