Search papers, labs, and topics across Lattice.
This paper introduces ConRTF, a novel approach for Table Structure Recognition (TSR) that enhances boundary localization by incorporating an Edge-constrained Fine-grained Localization loss (EFL) which emphasizes the distinct roles of rows and columns in table layouts. By encoding table-specific geometric priors into the training objective, the method ensures that row-like elements focus on horizontal boundaries while column-like elements prioritize vertical boundaries, leading to more accurate cell assignments. Experimental results on large datasets demonstrate that ConRTF achieves significant improvements in accuracy over existing real-time detectors while maintaining efficient data requirements, needing only 2k–3k annotated tables for robust performance.
Boundary localization errors in table structure recognition can be drastically reduced by treating rows and columns with distinct structural priorities, leading to up to +1.6 GriTS points improvement in accuracy.
Table Structure Recognition (TSR) aims to recover the row and column layout of tables from document images, a key step in document understanding pipelines. Accurate TSR depends on precise boundary localization: small errors in row or column boundaries can propagate into incorrect cell assignments and structural inconsistencies. Yet detection-based approaches treat table elements as generic objects, ignoring a fundamental property of table layout: rows and columns play structurally distinct roles and their boundaries carry unequal importance. We propose an Edge-constrained Fine-grained Localization loss (EFL) that formalizes this structural asymmetry by encoding table-specific geometric priors into the training objective: row-like elements are supervised with emphasis on their horizontal boundaries, while column-like elements prioritize vertical boundaries. Implemented within a real-time detector with distribution-based boundary refinement (D-FINE), EFL operates during training only and guides boundary refinement toward structurally meaningful adjustments with no change to the inference pipeline. The proposed approach, ConRTF, is also data-efficient, maintaining robust accuracy with as few as 2k--3k annotated tables. Experiments on PubTables-1M and two private datasets show consistent improvements over the optimized baseline and several real-time detectors including RT-DETRv2 and YOLOv10-11, with gains of up to +1.6 GriTS points at equal inference speed.
