Search papers, labs, and topics across Lattice.
This paper introduces CANOLA, a framework designed to correct corrupted labels in datasets through noise-aware learning and iterative label refinement. By estimating the underlying noise distribution and incorporating it into the training process, CANOLA effectively down-weights unreliable supervision signals, leading to improved model robustness and generalization. Experimental results demonstrate that CANOLA outperforms state-of-the-art label correction methods, achieving significant error reductions and enhancing downstream performance, even with simple classifiers.
CANOLA achieves up to 52% error reduction in label correction, enabling even simple models to outperform complex approaches by 67%.
High-quality labeled data is essential for training reliable ML/DL models. However, real-world datasets often contain a considerable proportion of corrupted labels, which can severely degrade model performance. To address this problem, we propose CANOLA, a novel framework for correcting corrupted labels through noise-aware learning and iterative label refinement. CANOLA explicitly estimates the underlying noise distribution of the dataset and incorporates this information into the training of a noise-aware Deep Neural Network. By incorporating noise characteristics during learning, CANOLA enables the model to down-weight unreliable supervision signals and focus on trustworthy patterns, thereby improving robustness and generalization. Label correction is performed via cautious, iterative soft label refinement, in which model predictions are blended with observed labels to prevent premature or erroneous updates. This progressive refinement allows the dataset to be repaired in a stable and controlled manner. We evaluate CANOLA on six widely used datasets under realistic noisy labeling scenarios. Experimental results show that CANOLA consistently outperforms SOTA label correction methods, achieving relative improvements ranging from 19% to 52% in error reduction. Moreover, models trained on datasets corrected by CANOLA obtain substantial downstream performance gains. Even simple classifiers trained on CANOLA's corrected data can outperform complex model-centric approaches by margins of up to 67%.