Search papers, labs, and topics across Lattice.
This paper addresses the problem of distribution shift in healthcare settings that degrades the coverage guarantees of conformal prediction methods. The authors evaluate several conformal prediction approaches on EEG seizure classification, a task known to exhibit distribution shifts and label uncertainty. They demonstrate that personalized calibration strategies significantly improve coverage (by >20%) while preserving prediction set sizes.
Personalized calibration can boost the coverage of conformal prediction by over 20% in EEG seizure classification, a task plagued by distribution shifts.
Quantifying uncertainty in clinical predictions is critical for high-stakes diagnosis tasks. Conformal prediction offers a principled approach by providing prediction sets with theoretical coverage guarantees. However, in practice, patient distribution shifts violate the i.i.d. assumptions underlying standard conformal methods, leading to poor coverage in healthcare settings. In this work, we evaluate several conformal prediction approaches on EEG seizure classification, a task with known distribution shift challenges and label uncertainty. We demonstrate that personalized calibration strategies can improve coverage by over 20 percentage points while maintaining comparable prediction set sizes. Our implementation is available via PyHealth, an open-source healthcare AI framework: https://github.com/sunlabuiuc/PyHealth.
