Search papers, labs, and topics across Lattice.
The paper introduces SegWithU, a post-hoc uncertainty estimation framework for medical image segmentation that adds a lightweight uncertainty head to a frozen, pre-trained segmentation backbone. SegWithU models uncertainty as perturbation energy in a compact probe space using rank-1 posterior probes, generating calibration-oriented and ranking-oriented uncertainty maps. Experiments on ACDC, BraTS2024, and LiTS datasets demonstrate that SegWithU achieves state-of-the-art single-forward-pass uncertainty estimation performance while maintaining segmentation quality.
Achieve near-perfect error detection in medical image segmentation with a single forward pass by modeling uncertainty as perturbation energy.
Reliable uncertainty estimation is critical for medical image segmentation, where automated contours feed downstream quantification and clinical decision support. Many strong uncertainty methods require repeated inference, while efficient single-forward-pass alternatives often provide weaker failure ranking or rely on restrictive feature-space assumptions. We present $\textbf{SegWithU}$, a post-hoc framework that augments a frozen pretrained segmentation backbone with a lightweight uncertainty head. SegWithU taps intermediate backbone features and models uncertainty as perturbation energy in a compact probe space using rank-1 posterior probes. It produces two voxel-wise uncertainty maps: a calibration-oriented map for probability tempering and a ranking-oriented map for error detection and selective prediction. Across ACDC, BraTS2024, and LiTS, SegWithU is the strongest and most consistent single-forward-pass baseline, achieving AUROC/AURC of $0.9838/2.4885$, $0.9946/0.2660$, and $0.9925/0.8193$, respectively, while preserving segmentation quality. These results suggest that perturbation-based uncertainty modeling is an effective and practical route to reliability-aware medical segmentation. Source code is available at https://github.com/ProjectNeura/SegWithU.
