Search papers, labs, and topics across Lattice.
This paper addresses the limitations of autoregressive decoders in multi-task table recognition by introducing a structural refinement module that generates order-independent cell representations using non-causal attention. By enabling parallel inference of cell contents while maintaining global context, the approach enhances both cell localization and content recognition. Experiments show significant improvements in performance and a reduction in inference time by approximately threefold across two large datasets.
Order-independent cell representations can triple inference speed while boosting localization and recognition accuracy in table recognition tasks.
Multi-task table recognition jointly addresses table structure prediction, cell localization, and cell content recognition within a unified framework. Existing approaches often rely on autoregressive decoders to generate table structures and reuse their hidden states for cell localization and content recognition. This autoregressive generation process can make cell representations order-dependent, degrading global consistency across cells. This paper proposes a structural refinement module that produces order-independent cell features through non-causal attention. This design enables parallel inference of cell contents while conditioning each cell on global context encoded in the refined features. Experiments on two large datasets demonstrate consistent gains in cell localization and end-to-end recognition, while reducing overall inference time by around threefold.