Search papers, labs, and topics across Lattice.
This paper introduces GEM-3, a novel probabilistic global weather forecasting model that utilizes explicit multi-timestep inference to optimize the trade-off between short-term predictability and long-term accuracy. By allowing the model timestep to be adjusted at inference time, GEM-3 enhances usability across various forecast horizons while maintaining stability during rollouts. The authors demonstrate that mixed-timestep training outperforms traditional timestep-specialist models, resulting in a lightweight architecture with improved forecasting capabilities and decision-relevant diagnostics.
A single model can now adaptively balance short-term precision and long-term accuracy in weather forecasts, revolutionizing how we approach atmospheric predictions.
Existing machine-learning weather forecasting models rely on predetermined and fixed autoregressive timesteps. The choice of model timestep involves a fundamental trade-off: shorter timesteps (e.g. 1 to 6 hours) finely resolve atmospheric dynamics within the diurnal cycle but increase error accumulation for a given forecast horizon, while longer timesteps (e.g. 24 hours) reduce error accumulation but limit the usability of short-range forecasts where sub-daily predictability is high. In this work, we present GEM-3, a probabilistic global weather model that addresses this trade-off through explicit multi-timestep inference. With a single set of trained weights, the model timestep can be configured at inference time to balance predictability and usability across a broad forecast horizon. Additionally, we find that mixed-timestep training consistently improves rollout stability relative to timestep-specialist models. Under the hood, GEM-3 is a lightweight neighborhood-attention transformer with ~134M parameters on an equirectangular grid with a number of architectural advancements beyond its predecessor GEM-2. The result is a practical forecasting system that couples near-SOTA medium-range probabilistic skill, stable extended-range rollouts, efficient training and inference, and decision-relevant diagnostics.
