Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Xaurora, a generative weather forecasting model derived from a pretrained deterministic foundation model (Aurora) by employing Denoising Stochastic Interpolants and a replay buffer for SDE trajectory generation. This approach enables probabilistic forecasting and ensemble generation, addressing limitations of existing deterministic foundation models in uncertainty quantification and extreme event assessment. Xaurora achieves state-of-the-art ensemble metrics and competitive 15-day forecasts with significantly reduced computational cost.
Deterministic weather foundation models can be efficiently transformed into powerful probabilistic forecasters, generating skillful 15-day forecasts in minutes.
Deep learning has revolutionised weather forecasting in recent years, especially through atmospheric foundation models, which offer competitive skill for a fraction of the computational costs of classic physics-based models. However, most existing foundation models are deterministic, limiting the generation of large ensembles for accurate uncertainty quantification, extreme weather risk assessment, and long-range weather forecasting. Furthermore, these models incur a large, often prohibitive, computational overhead to train from scratch. To address these shortcomings, we turn a pretrained deterministic prior model, namely the Aurora foundation model, into a generative ensemble-prediction model. To that end, we introduce a novel generative method, Denoising Stochastic Interpolants, combined with a replay buffer for Stochastic Differential Equation (SDE) rollout, enabling probabilistic training of SDE trajectories. Our stochastic foundation model, Xaurora, is finetuned from the small Aurora version, yet it approaches the state-of-the-art on global ensemble metrics and is competitive with the large version of Aurora. Our method is parameter and sample efficient, and generates skilful 15-day forecasts in 13 minutes. Our results demonstrate that deterministic foundation models can be efficiently extended into even stronger stochastic models.