Search papers, labs, and topics across Lattice.
This paper extends generalized conformal predictive systems (CPS) to handle non-exchangeable settings by incorporating observation-specific permutation weights to account for distributional shifts. The proposed method ensures that the predictive bands remain valid when the test point is a weighted draw from the observed data, addressing the limitations of traditional CPS under varying conditions. Experimental results demonstrate that the shift-aware CPS yields calibrated predictive bands that adaptively widen with stronger shifts and tighten with larger sample sizes, showcasing its robustness in practical applications such as biomolecular design.
Shift-aware conformal predictive systems can maintain calibration even under significant distributional shifts, adapting dynamically to sample size and conditions.
Conformal predictive systems (CPS) output calibrated bands of CDFs under exchangeability. We extend generalized CPS to non-exchangeable settings by encoding distributional shifts through observation-specific permutation weights. This yields shift-aware predictive systems that remain valid whenever the test point is, conditionally on the unordered sample, a weighted draw from the observed atoms. Since such weights are typically estimated, we introduce weight-uncertainty boxes and construct robust CPS envelopes with finite-sample or asymptotic confidence guarantees. We derive efficient computation for conformity-measure CPS, conformal binning, and conformal isotonic distributional regression. Experiments under covariate shift and feedback-driven biomolecular design show calibrated predictive bands that widen under stronger shifts and tighten as sample size increases.
ETH