Search papers, labs, and topics across Lattice.
This paper tackles online conformal prediction, a method for uncertainty quantification, in the challenging setting of adversarial semi-bandit feedback where labels are revealed only if they fall within the predicted set. They formulate the problem as an adversarial bandit problem, treating each candidate prediction set as an arm, and leverage regret minimization techniques to achieve long-run coverage guarantees. Experiments validate the method's ability to control miscoverage rate and maintain reasonable prediction set sizes in both i.i.d. and non-i.i.d. environments.
Guaranteeing uncertainty quantification in dynamic environments is now possible even when feedback is strategically withheld by an adversary.
Uncertainty quantification is crucial in safety-critical systems, where decisions must be made under uncertainty. In particular, we consider the problem of online uncertainty quantification, where data points arrive sequentially. Online conformal prediction is a principled online uncertainty quantification method that dynamically constructs a prediction set at each time step. While existing methods for online conformal prediction provide long-run coverage guarantees without any distributional assumptions, they typically assume a full feedback setting in which the true label is always observed. In this paper, we propose a novel learning method for online conformal prediction with partial feedback from an adaptive adversary-a more challenging setup where the true label is revealed only when it lies inside the constructed prediction set. Specifically, we formulate online conformal prediction as an adversarial bandit problem by treating each candidate prediction set as an arm. Building on an existing algorithm for adversarial bandits, our method achieves a long-run coverage guarantee by explicitly establishing its connection to the regret of the learner. Finally, we empirically demonstrate the effectiveness of our method in both independent and identically distributed (i.i.d.) and non-i.i.d. settings, showing that it successfully controls the miscoverage rate while maintaining a reasonable size of the prediction set.
