Search papers, labs, and topics across Lattice.
This paper compares TrOCR and Qwen, a vision-language model, on historical English OCR, using length-weighted accuracy and error analysis to evaluate their suitability for scholarly use. The study reveals that while Qwen achieves lower CER/WER and greater robustness, it introduces linguistic regularization and orthographic normalization, potentially altering historically significant forms. Conversely, TrOCR maintains better orthographic fidelity but is more susceptible to error propagation, highlighting the impact of architectural inductive biases on OCR error patterns.
Seemingly superior OCR accuracy from VLMs can mask problematic linguistic regularization and orthographic normalization that silently alter historically meaningful text.
Optical Character Recognition (OCR) of eighteenth-century printed texts remains challenging due to degraded print quality, archaic glyphs, and non-standardized orthography. Although transformer-based OCR systems and Vision-Language Models (VLMs) achieve strong aggregate accuracy, metrics such as Character Error Rate (CER) and Word Error Rate (WER) provide limited insight into their reliability for scholarly use. We compare a dedicated OCR transformer (TrOCR) and a general-purpose Vision-Language Model (Qwen) on line-level historical English texts using length-weighted accuracy metrics and hypothesis driven error analysis. While Qwen achieves lower CER/WER and greater robustness to degraded input, it exhibits selective linguistic regularization and orthographic normalization that may silently alter historically meaningful forms. TrOCR preserves orthographic fidelity more consistently but is more prone to cascading error propagation. Our findings show that architectural inductive biases shape OCR error structure in systematic ways. Models with similar aggregate accuracy can differ substantially in error locality, detectability, and downstream scholarly risk, underscoring the need for architecture-aware evaluation in historical digitization workflows.
