Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
R2-GP introduces a novel R2D2-type prior for Gaussian process generalized additive models, specifically addressing the variance calibration issue with Matérn kernels where function variance is jointly dependent on effect magnitude and length-scale. By rescaling component variances based on length-scale and input data to directly control expected prior explained variance, R2-GP mitigates variance overestimation and scales effectively to numerous components. Extensions to Hilbert space approximation further enable efficient inference for large datasets, leading to superior generalization and parameter recovery compared to independent variance priors.
Gaussian process additive models can now precisely control the prior explained variance of each component, overcoming the inherent variance overestimation of standard Matérn priors.
We develop R2-GP, an R2D2-type prior for Gaussian process (GP) generalised additive models (GAMs) that calibrates explained variance ($R^2$) for Matérn covariance kernels. The function variance for standard Matérn kernels depends jointly on the effect magnitude and length-scale. As such, smooth and rough components with identical amplitudes contribute very different amounts of variation. With independent priors on component amplitudes, this variation results in variance overestimation, especially in higher dimensions. We overcome this by taking direct control over each component's expected contribution to prior explained variance. We do this by rescaling each component based on its length scale and observed inputs, and modelling each rescaled variance as a share of the function variance induced by a global $R^2$ prior. This allows R2-GP to scale well to many components. To also scale to large sample sizes, we extend R2-GP to Hilbert space approximation methods, a framework for kernels exploiting their spectral decompositions for fast and efficient inference. Our simulations and real-world case studies demonstrate superior generalisation and parameter recovery over independent variance priors.