Search papers, labs, and topics across Lattice.
This paper introduces a novel method for estimating the label-noise transition matrix by employing one-sided selective classification, thereby circumventing the need for fragile class-posterior estimation. The proposed approach offers finite-sample performance guarantees, a significant improvement over existing methods that lack such assurances. The work also details practical algorithms and refined performance bounds for this new methodology.
Finite-sample performance guarantees for label-noise transition matrix estimation are now achievable by bypassing class-posterior estimation through one-sided selective classification.
Modern machine learning depends heavily on massive datasets, but obtaining high-quality annotations at scale is often expensive. As a result, learning from noisily-labeled data has become common, making accurate estimation of the label-noise transition matrix crucial. However, existing transition matrix estimators rely on the fragile estimation of class-posteriors and do not provide finite-sample performance guarantees. In this work, we propose a novel methodology to estimate the transition matrix based on one-sided selective classification. This approach bypasses class-posterior estimation, provides finite-sample performance guarantees, and leverages flexible learning methods for binary classification. Moreover, we introduce effective algorithms to implement the proposed methodology and provide their refined finite-sample performance bounds.