Search papers, labs, and topics across Lattice.
This study explores the use of conformal prediction (CP) for uncertainty quantification in numerical weather prediction, specifically within a one-dimensional modified shallow water model. By comparing three variants of CP against traditional ensemble-based measures, the authors evaluate metrics such as empirical coverage and average interval score loss (AISL). The findings reveal that while CP can effectively complement traditional methods, it also has distinct strengths and limitations that are crucial for enhancing probabilistic forecasting in atmospheric models.
Conformal prediction can significantly enhance uncertainty quantification in weather forecasting, but it comes with its own set of strengths and limitations compared to traditional ensemble methods.
Quantifying the evolution of uncertainty is critical to both probabilistic forecasting and data assimilation in numerical weather prediction. In this study, we investigate the applicability of conformal prediction (CP), a recent machine learning (ML) method, to quantify uncertainty in a controlled, idealized setting. We use the one dimensional modified shallow water model, designed to mimic the convective process. CP provides a set of possible outcomes with a chosen confidence level. Here, we compare and evaluate the average empirical coverage, the average interval length, miss low, miss high and average interval score loss (AISL) for three variants of CP, namely a) Standard CP, b) Normalized CP and c) Conformalized Quantile Regression. We further compare these CP-based uncertainty estimates with traditional ensemble-based measures such as standard deviation intervals and ensemble spread. In addition, we investigate the integration of CP-derived uncertainty within the data assimilation cycle through CP perturbations. Our results highlight the strengths and limitations of each approach, providing insight into the effectiveness of CP to complement common ensemble-based uncertainty quantification in simplified atmospheric models.
