Search papers, labs, and topics across Lattice.
This paper introduces a benchmark for webly supervised multi-label recognition (WS-MLR) by creating two datasets, Web-COCO and Web-Pascal, which consist of approximately 300,000 images sourced from the internet. The authors also propose a Dual-Branch Multi-Label Contrastive Learning (DBMLCL) framework that effectively learns both instance-level and category-level representations while addressing label noise. Experimental results show that DBMLCL significantly outperforms existing baselines, highlighting the potential of webly supervised learning in multi-label contexts.
Webly supervised multi-label recognition can achieve state-of-the-art performance with a novel dual-branch learning approach that tackles label noise head-on.
Training deep learning models with freely available web images can reduce their dependence on costly manual annotations. Although webly supervised learning has been widely studied for single-label recognition, its multi-label counterpart remains underexplored, partly due to the lack of unified benchmarks and fair comparison protocols. To address this gap, we construct a benchmark for webly supervised multi-label recognition (WS-MLR), including Web-COCO and Web-Pascal, and re-implement representative baselines under a unified setting. The two datasets cover the same 80 and 20 categories as MS-COCO and Pascal VOC, respectively, and contain about 300 thousand images retrieved from the Internet using category-word combinations as search keywords. We further propose a Dual-Branch Multi-Label Contrastive Learning (DBMLCL) framework, which learns category-specific instance-level and category-level representations together with their similarities to identify and correct noisy labels. Extensive experiments on the benchmark demonstrate that DBMLCL achieves superior performance compared to representative baselines.
