Search papers, labs, and topics across Lattice.
This paper introduces Dynamic Unreliability-Driven Coreset Selection (DUCS), a novel coreset selection strategy tailored for medical image classification that focuses on unreliable samples near decision boundaries. DUCS uses an inward-backward unreliability assessment, quantifying sample uncertainty via confidence evolution during training and tracking sample forgetting frequency. Experiments on medical datasets demonstrate that DUCS outperforms state-of-the-art coreset selection methods, especially at high compression rates, by strategically selecting samples that refine decision boundaries.
Counterintuitively, the most *unreliable* samples in medical imaging datasets鈥攖hose with fluctuating confidence and frequent forgetting during training鈥攁re the *most* informative for building accurate decision boundaries.
Efficiently managing and utilizing large-scale medical imaging datasets with limited resources presents significant challenges. While coreset selection helps reduce computational costs, its effectiveness in medical data remains limited due to inherent complexity, such as large intra-class variation and high inter-class similarity. To address this, we revisit the training process and observe that neural networks consistently produce stable confidence predictions and better remember samples near class centers in training. However, concentrating on these samples may complicate the modeling of decision boundaries. Hence, we argue that the more unreliable samples are, in fact, the more informative in helping build the decision boundary. Based on this, we propose the Dynamic Unreliability-Driven Coreset Selection(DUCS) strategy. Specifically, we introduce an inward-backward unreliability assessment perspective: 1) Inward Self-Awareness: The model introspects its behavior by analyzing the evolution of confidence during training, thereby quantifying uncertainty of each sample. 2) Backward Memory Tracking: The model reflects on its training tracking by tracking the frequency of forgetting samples, thus evaluating its retention ability for each sample. Next, we select unreliable samples that exhibit substantial confidence fluctuations and are repeatedly forgotten during training. This selection process ensures that the chosen samples are near the decision boundary, thereby aiding the model in refining the boundary. Extensive experiments on public medical datasets demonstrate our superior performance compared to state-of-the-art(SOTA) methods, particularly at high compression rates.
