Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The authors develop an empirical Bayes framework that automatically tunes the hyperparameters of a heteroscedastic Spectral-normalized Neural Gaussian Process (SNGP) directly within the end-to-end training loop. Scalable, well-calibrated uncertainty quantification has historically remained computationally intractable for high-dimensional scientific surrogates due to expensive outer-loop hyperparameter sweeps. Tested on dynamic aperture estimation for the CERN Large Hadron Collider, the method matches state-of-the-art predictive accuracy with well-calibrated error bars at a fraction of the computational budget of standard approaches.
Calibrated uncertainty quantification in deep scientific surrogates no longer requires expensive outer-loop sweeps: embedding empirical Bayes directly into heteroscedastic neural Gaussian processes delivers calibrated predictions at dramatically reduced compute.
We address the challenge of scalable uncertainty quantification in large-scale scientific applications, where complex state-of-the-art machine learning methods are often computationally infeasible. Our primary contribution is a simple yet effective empirical Bayes method for automatically tuning the hyperparameters of a flexible, heteroscedastic Spectral-normalized Neural Gaussian Process. This approach retains the expressiveness and uncertainty-awareness of semi-Bayesian neural models while significantly reducing the computational burden by integrating hyperparameter learning directly into the training loop. We demonstrate the practical impact of our method on the task of estimating the dynamic aperture in circular particle accelerators, a fundamental problem in high-energy physics colliders and storage rings, using simulation data from the case of the Large Hadron Collider at CERN. Traditional approaches to DA estimation require extensive particle-tracking simulations, which are prohibitively time-consuming and resource-intensive. Our results show that the proposed method achieves competitive predictive performance and well-calibrated uncertainty estimates at much lower computational cost than state-of-the-art approaches. We stress that, beyond this application, the proposed empirical Bayes framework offers a general solution for training heteroscedastic neural models in situations where manual hyperparameter tuning is impractical. Accordingly, we anticipate that this framework can be applied to other domains that encounter comparable computational limitations.