Search papers, labs, and topics across Lattice.
This paper introduces RT-DocLayout, an efficient end-to-end framework for document layout analysis that integrates classification, detection, pixel-level segmentation, and reading order prediction within a single 33M-parameter architecture. By utilizing a unified multi-task formulation based on RT-DETR, the model effectively addresses the challenges posed by geometric distortions and complex layout structures, achieving state-of-the-art performance while maintaining real-time inference speeds of 132.1 FPS. The results indicate that RT-DocLayout not only enhances robustness against real-world document variations but also significantly improves full-document reconstruction quality when integrated with downstream OCR systems.
Achieving real-time document layout analysis at 132.1 FPS, RT-DocLayout unifies multiple tasks into a single model, drastically improving robustness against geometric distortions.
Accurate document layout analysis remains a critical bottleneck for document parsing systems, due to the intricate coupling among heterogeneous document layout elements, geometric distortions (\eg, paper warping and bending, perspective variations), and reading order within diverse layout structures. Existing approaches typically rely on fragmented multi-stage pipelines or computationally heavy generative Transformer architectures, leading to error propagation and limited efficiency. In this paper, we present RT-DocLayout, a highly efficient end-to-end framework for document layout analysis, designed as a front-end for document parsing tasks. The proposed model unifies classification, detection, pixel-level segmentation, and reading order prediction for layout elements within a single 33M-parameter architecture. Built upon the RT-DETR, our key contribution is a unified multi-task formulation within a single query-based decoder that simultaneously classifies, regresses bounding box, generates masks, and constructs relationship to reason reading order. By jointly learning geometric and structural representations, RT-DocLayout introduces multi-task optimization that substantially improves robustness under real-world document distortions. Extensive experiments on public benchmarks demonstrate state-of-the-art performance in document layout analysis while maintaining real-time inference speed(132.1 FPS). When coupled with downstream OCR engines, RT-DocLayout significantly improves full-document reconstruction quality, providing a scalable and practical foundation for real-world document intelligence systems.
