Search papers, labs, and topics across Lattice.
This paper introduces QUAM-SM, a post-hoc framework that utilizes targeted adversarial search to identify "adversarially fragile" pixels in medical image segmentation, thereby enhancing pixel-level uncertainty quantification. By effectively disentangling epistemic from aleatoric uncertainty, QUAM-SM reveals regions where model predictions are most vulnerable, addressing the common issue of miscalibration in standard deep learning models. Experimental results on two public datasets show that QUAM-SM significantly outperforms existing uncertainty estimation methods, improving reliability and sensitivity to boundaries critical for clinical decision-making.
QUAM-SM reveals hidden vulnerabilities in medical image segmentation models, enhancing uncertainty quantification and clinical reliability.
Reliable pixel-level uncertainty quantification holds the potential to transform clinical workflows by enabling high-fidelity longitudinal monitoring and distinguishing true pathological changes from artifacts. Ideally, these models provide the stability required for critical treatment planning and surgical intervention. However, standard deep learning models often suffer from miscalibration, yielding overconfident predictions that mask underlying vulnerabilities at subtle pathological boundaries. To address this, we propose QUAM-SM, a post-hoc framework using targeted adversarial search to identify "adversarially fragile" pixels. By actively seeking perturbations that expose predictive instability, our method highlights regions where decisions are most vulnerable to being flipped. Importantly, the framework disentangles epistemic uncertainty from aleatoric uncertainty. Experiments on two public datasets with multiple expert annotations demonstrate that QUAM-SM outperforms both standard and recent uncertainty estimation approaches in terms of reliability and boundary sensitivity. Code is available at https://github.com/HanaJebril/quam_sm