Search papers, labs, and topics across Lattice.
The paper introduces Co-optimization for Adaptive Conformal Prediction (CoCP), a novel framework for constructing more efficient conformal prediction intervals, particularly under heteroscedasticity and skewness. CoCP jointly optimizes the interval center and radius by alternating between quantile regression on folded absolute residuals and refining the center with a differentiable soft-coverage objective. The method guarantees finite-sample marginal validity via split-conformal calibration and demonstrates improved interval lengths and conditional coverage on synthetic and real datasets.
Conformal prediction intervals can be dramatically shortened and better calibrated by co-optimizing the interval's center and radius, rather than relying on fixed centers or equal-tailed errors.
Conformal prediction (CP) provides finite-sample, distribution-free marginal coverage, but standard conformal regression intervals can be inefficient under heteroscedasticity and skewness. In particular, popular constructions such as conformalized quantile regression (CQR) often inherit a fixed notion of center and enforce equal-tailed errors, which can displace the interval away from high-density regions and produce unnecessarily wide sets. We propose Co-optimization for Adaptive Conformal Prediction (CoCP), a framework that learns prediction intervals by jointly optimizing a center $m(x)$ and a radius $h(x)$.CoCP alternates between (i) learning $h(x)$ via quantile regression on the folded absolute residual around the current center, and (ii) refining $m(x)$ with a differentiable soft-coverage objective whose gradients concentrate near the current boundaries, effectively correcting mis-centering without estimating the full conditional density. Finite-sample marginal validity is guaranteed by split-conformal calibration with a normalized nonconformity score. Theory characterizes the population fixed point of the soft objective and shows that, under standard regularity conditions, CoCP asymptotically approaches the length-minimizing conditional interval at the target coverage level as the estimation error and smoothing vanish. Experiments on synthetic and real benchmarks demonstrate that CoCP yields consistently shorter intervals and achieves state-of-the-art conditional-coverage diagnostics.
