Search papers, labs, and topics across Lattice.
This paper introduces a novel "self-assembled" Wishart prior for the covariance matrix within Gaussian Process (GP) learning, designed to improve inference when dealing with multiple lengthscale parameters in highly multivariate functions. The key innovation is a time-step dependent scale matrix derived from a look-back window over recent MCMC iterations, enabling adaptiveness during Bayesian inference on kernel hyperparameters. Empirical results on synthetic and real-world datasets demonstrate the utility of this direct prior specification on the covariance matrix for identifying weakly informative inputs in GP-based learning.
A dynamically updated Wishart prior for GP covariance matrices lets you diagnose uninformative inputs, potentially streamlining feature selection and improving model efficiency.
In probabilstic supervised learning of an input-output relationship - as a sample function of a Gaussian Process (GP) - priors are typically specified for the hyperparameters of the kernel that parametrises the covariance function of the GP, where the induced covariance matrix of the (resulting multivariate Normal) likelihood, governs the learning and prediction. When the sought function is highly multivariate, multiple lengthscale parameters must be learnt simultaneously, making inference difficult. We develop a ``self-assembled'' Wishart prior for the covariance matrix, while undertaking Bayesian inference on the kernel hyperparameters using MCMC. The construction uses a look-back window over recent MCMC iterations to define a time-step dependent scale matrix, thereby introducing adaptiveness to the chain. Results suggest that direct prior specification on the covariance matrix can be useful for diagnosing weakly informative inputs within the GP-based learning paradigm. We support our prior development with two distinct empirical illustrations - one on synthetic data, and another on a real-world dataset.
