Search papers, labs, and topics across Lattice.
This paper introduces PorTEXTO, the first benchmark specifically designed for visual text extraction in contemporary European Portuguese (pt-PT), addressing a significant gap in existing OCR benchmarks that predominantly focus on high-resource languages. The authors implement a robust annotation pipeline that combines transcriptions from a leading large vision-language model (LVLM) with thorough reviews by native speakers to ensure quality. Key findings reveal a notable performance decline when transitioning from synthetic to real-world samples, highlighting that specialized multilingual data significantly enhances pt-PT OCR performance more than model size or resolution alone.
Specialized multilingual data outperforms model size in enhancing OCR performance for European Portuguese, revealing critical insights for future benchmarks.
European Portuguese (pt-PT) is largely absent from OCR benchmarks, which skew toward high-resource languages. The few benchmarks that cover pt-PT focus on historical artifacts and literature. This work addresses modern OCR applications, introducing PorTEXTO, the first benchmark for contemporary and culturally relevant pt-PT visual text extraction. To ascertain quality, we employ an annotation pipeline combining transcriptions from a frontier LVLM with exhaustive review by native speakers. We observe a sharp performance drop from synthetic to real world samples in most models, and find that, currently, specialized multilingual data is a better driver for pt-PT performance than model size or resolution budget, motivating the release of open pt-PT OCR resources.
