Search papers, labs, and topics across Lattice.
This paper benchmarks State-Space Models (SSMs), specifically Mamba, against Transformers and BiLSTMs for historical newspaper OCR, focusing on computational efficiency for long sequences. They introduce a novel OCR architecture combining a CNN encoder with bidirectional and autoregressive Mamba sequence modeling. Results show Mamba achieves competitive accuracy with significantly reduced inference time and improved memory scaling, particularly at the paragraph level, making it a viable alternative to Transformers for large-scale OCR.
Forget quadratic complexity: Mamba-based OCR rivals Transformer accuracy while halving inference time and scaling memory more efficiently, finally making paragraph-level historical text transcription practical.
End-to-end OCR for historical newspapers remains challenging, as models must handle long text sequences, degraded print quality, and complex layouts. While Transformer-based recognizers dominate current research, their quadratic complexity limits efficient paragraph-level transcription and large-scale deployment. We investigate linear-time State-Space Models (SSMs), specifically Mamba, as a scalable alternative to Transformer-based sequence modeling for OCR. We present to our knowledge, the first OCR architecture based on SSMs, combining a CNN visual encoder with bi-directional and autoregressive Mamba sequence modeling, and conduct a large-scale benchmark comparing SSMs with Transformer- and BiLSTM-based recognizers. Multiple decoding strategies (CTC, autoregressive, and non-autoregressive) are evaluated under identical training conditions alongside strong neural baselines (VAN, DAN, DANIEL) and widely used off-the-shelf OCR engines (PERO-OCR, Tesseract OCR, TrOCR, Gemini). Experiments on historical newspapers from the Biblioth猫que nationale du Luxembourg, with newly released >99% verified gold-standard annotations, and cross-dataset tests on Fraktur and Antiqua lines, show that all neural models achieve low error rates (~2% CER), making computational efficiency the main differentiator. Mamba-based models maintain competitive accuracy while halving inference time and exhibiting superior memory scaling (1.26x vs 2.30x growth at 1000 chars), reaching 6.07% CER at the severely degraded paragraph level compared to 5.24% for DAN, while remaining 2.05x faster. We release code, trained models, and standardized evaluation protocols to enable reproducible research and guide practitioners in large-scale cultural heritage OCR.
