Search papers, labs, and topics across Lattice.
This paper introduces Bounding Box Label Propagation (BBLP), a novel pseudo-labelling framework designed to enhance the re-annotation of object detection instances in document layout analysis. By integrating visual, textual, and positional embeddings, BBLP effectively propagates labels across partially annotated datasets, achieving a mean Average Precision (mAP) of 54.0% with only 10% of the data labeled, which is 81.6% of the performance of fully supervised methods. This approach significantly reduces the manual effort required for dataset re-annotation, making it a practical solution for evolving document processing scenarios.
Achieving 81.6% of fully supervised performance with just 10% labeled data, BBLP revolutionizes the efficiency of document layout re-annotation.
Datasets in practical document processing scenarios typically grow over time, and their class annotations undergo continuous refinement. This creates significant re-annotation efforts, which are time-consuming and costly. A promising remedy is to re-annotate only a small subset of available documents manually and apply semi-supervised learning techniques that leverage both labelled and unlabelled data. Although there are numerous approaches to tackle this problem for classification, there exists no adaptation for the problem of re-classifying object detection instances, e.g. for document layout analysis. To this end, we propose Bounding Box Label Propagation (BBLP), a pseudo-labelling framework for object detection. An object encoder integrates visual, textual, and positional embeddings from object detection samples to come up with a joint embedding that can be used for Label Propagation on partially annotated datasets in a plug-and-play fashion. Evaluation results indicate that the proposed approach produces high-quality class annotations of bounding boxes. In the D4LA layout analysis dataset, it achieves a mAP of 54.0%, corresponding to 81.6% of fully supervised performance, while using only 10% labelled data. Our work demonstrates the potential of Label Propagation for object detection and lays the groundwork for reducing manual annotation efforts in real-world document processing applications.