Search papers, labs, and topics across Lattice.
This paper adapts Uncertainty Herding (UHerding) for active learning in cascaded object detection, specifically targeting table extraction from business documents. By introducing two pipeline-aware extensions鈥擱ankFusion and CAPA鈥攖hat leverage the inter-stage dependencies between Table Detection and Table Structure Recognition, the authors effectively reduce the annotation burden while improving performance. Extensive experiments demonstrate that these adaptations not only generalize well across multiple datasets but also highlight CAPA as the most consistent strategy, outperforming standard UHerding in three out of four scenarios.
Active learning can significantly reduce annotation costs in table extraction pipelines, with CAPA emerging as the most reliable strategy for balancing coverage and uncertainty.
Table extraction from business documents relies on a cascaded pipeline where Table Detection (TD) first localizes tables and Table Structure Recognition (TSR) then recovers their internal layout. Building task-specific training sets for this pipeline is costly, particularly for TSR which requires fine-grained structural annotations. Active learning (AL) can reduce this annotation burden, yet most AL strategies are designed for single-model tasks and do not account for inter-stage dependencies in cascaded architectures. In this work, we present the first adaptation of Uncertainty Herding (UHerding), a hybrid coverage-uncertainty sampling method originally proposed for image classification, to cascaded object detection pipelines. We propose two pipeline-aware extensions that exploit the TD-to-TSR dependency: RankFusion adds dual-manifold coverage over both detection and structure representation spaces, while CAPA further incorporates stage-dependent gating and per-task uncertainty calibration. Extensive experiments across two public (PubTables-1M and FinTabNet) and two private table extraction datasets, with various annotation budgets (from 71 to 500 documents) show that UHerding generalizes well to table extraction, outperforming each baseline. Among pipeline-aware variants, RankFusion achieves higher expected gains but at the cost of greater variance, while CAPA emerges as the most consistent strategy, outperforming standard UHerding on three out of four datasets.
