Search papers, labs, and topics across Lattice.
This paper extends conformal risk control to handle non-monotonic loss functions with multidimensional parameters, going beyond the original algorithm's limitation to monotonic losses with one-dimensional parameters. The authors provide risk control guarantees that depend on the stability of the underlying algorithm, with less stable algorithms yielding looser guarantees. They demonstrate the applicability of this technique to selective image classification, FDR and IOU control for tumor segmentation, and multigroup debiasing of recidivism predictions.
Conformal risk control now handles complex, non-monotonic losses, opening the door to more reliable uncertainty quantification in real-world applications like medical imaging and fairness-aware prediction.
Conformal risk control is an extension of conformal prediction for controlling risk functions beyond miscoverage. The original algorithm controls the expected value of a loss that is monotonic in a one-dimensional parameter. Here, we present risk control guarantees for generic algorithms applied to possibly non-monotonic losses with multidimensional parameters. The guarantees depend on the stability of the algorithm -- unstable algorithms have looser guarantees. We give applications of this technique to selective image classification, FDR and IOU control of tumor segmentations, and multigroup debiasing of recidivism predictions across overlapping race and sex groups using empirical risk minimization.
