Search papers, labs, and topics across Lattice.
To address severe performance drops on multi-script document understanding caused by script and font overfitting, the authors release MANDALA鈥攁 15-script, 18-language benchmark鈥攁nd EMBLEM, a script-agnostic masking framework for table detection. Current vision-based document detectors heavily rely on script-specific typographic features, rendering them brittle on non-Latin layouts without labor-intensive multilingual annotation. Crucially, fine-tuning solely on masked English documents transfers effectively across diverse scripts, yielding a 20.8% absolute F1 gain on MANDALA while preserving competitive performance on standard English datasets.
Masking text-level script and font details during English-only training yields a massive 20.8% absolute F1 boost across 15 unseen multi-script languages without requiring a single multilingual training sample.
Table detection is a core task in document analysis, supporting downstream applications such as information retrieval, document reconstruction, and visual question answering. While existing deep learning models perform well on English and Chinese documents, they struggle with multilingual, multi-script documents due to script diversity and the limited availability of labeled data. To address this challenge, we introduce MANDALA (Multi-script Annotated Documents for Table Detection), a manually curated dataset of 2,323 table-containing pages spanning 18 languages and 15 scripts across diverse domains. We also propose EMBLEM, a masking-based paradigm for Multi-script Table Detection (MTD). EMBLEM generates masked images that conceal script- and font-specific details, enabling models pre-trained on abundant English documents to focus on script-agnostic page layout. Experiments across three table detection architectures show that EMBLEM consistently outperforms strong baselines on MANDALA while remaining competitive on five standard English-dominant benchmarks. Using only English masked images for fine-tuning, with no multi-script training data, EMBLEM achieves an absolute F1-score gain of 20.8% on MANDALA. We release MANDALA along with the accompanying code and models at https://github.com/IITB-LEAP-OCR/EMBLEM.git.
