Search papers, labs, and topics across Lattice.
This paper establishes a theoretical framework for optimal data splitting in split conformal prediction, addressing the critical issue of how to allocate data between training and calibration samples to minimize prediction interval length while ensuring coverage. The authors derive analytical characterizations of the optimal split ratio for both symmetric and asymmetric scenarios and apply these findings to various regression contexts, including linear and nonparametric regression, as well as neural networks. Their experiments validate the proposed methodology, showing significant improvements in prediction interval efficiency across synthetic and real-world datasets.
Achieving shorter prediction intervals in split conformal prediction could revolutionize uncertainty quantification in machine learning applications.
Conformal prediction and its variants, including the split conformal prediction, provide a distribution-free framework for uncertainty quantification by constructing prediction intervals or sets with finite-sample coverage guarantees. The statistical efficiency of these intervals depends critically on how the data are split into training and calibration samples. Despite its practical importance, a principled characterization of the training-calibration split that minimizes prediction interval length while maintaining coverage has remained largely unresolved. In this paper, we develop a theoretical framework for optimal data splitting in split conformal prediction. We first analyze the problem in a general setting and derive analytical characterizations of the length-optimal split ratio under both symmetric and asymmetric regimes. We then show how the general results specialize to several commonly used regression settings, including linear regression, nonparametric regression, and neural networks, thereby demonstrating the scope of the framework. We also describe a data-based method for selecting the optimal proportion. Our analysis clarifies how model-related features govern the optimal allocation of samples between training and calibration and provides principled guidance for constructing shorter prediction intervals. Experiments on both synthetic and real-world datasets demonstrate the applicability of the proposed methodology across a variety of practical scenarios.
