Search papers, labs, and topics across Lattice.
This paper introduces TableParseMap, a diagnostic benchmark designed to evaluate the performance of document parsers on complex real-world tables, revealing that existing models achieve only 85.03 TEDS despite high aggregate scores. The authors identify three key limitations in current parsing methods: the inability to handle large tables effectively, challenges posed by weak visual cues, and inconsistencies between reconstructed tables and their original images. To address these issues, they propose the DEC framework, which enhances frozen parsers through a structured process of decomposition, enhancement, and correction, leading to significant improvements in parsing accuracy, particularly for large tables and structural errors.
Existing document parsers may score high on benchmarks, but they still falter on real-world tables, with a top parser achieving only 85.03 TEDS.
Recent document parsers achieve table TEDS scores above 93 on OmniDocBench v1.6, yet community feedback and our audit reveal persistent failures on complex real-world tables. To quantify this gap, we introduce TableParseMap, a diagnostic benchmark of 916 real-world tables organized into five challenging scenarios and nine failure types. The strongest evaluated parser achieves only 85.03 TEDS, showing that aggregate benchmark scores conceal substantial weaknesses. Our analysis attributes these failures to three complementary limitations: large tables exceed the reliable processing scale of a single pass, weak or ambiguous visual cues hinder structure perception, and the reconstructed table may remain visually inconsistent with the image. We therefore propose DEC (Decompose--Enhance--Correct), a visual-consistency-guided agentic framework that improves frozen table parsers without retraining. DEC uses a general VLM as the controller: Decompose partitions large tables along structure-aware boundaries, Enhance exposes weak visual evidence and reparses transformed views, and Correct diagnoses and repairs residual errors. A Visual Consistency Gate (VC-Gate) selectively triggers intervention, while a Visual Consistency Ranker (VC-Ranker) verifies candidate updates and supports rollback without ground-truth HTML at inference time. We further derive a 1,977-table Consensus-Hard Set from 4,556 candidates through offline metrics and cross-model consensus. Across three frozen parsers, DEC improves TEDS by 1.57 points on average; on TableParseMap, gains reach 1.89 points overall, 2.62 on structural errors, and 5.66 on large tables.
