Search papers, labs, and topics across Lattice.
The paper introduces Transformed Latent Variable Multi-Output Gaussian Process (T-LVMOGP), a scalable MOGP framework for high-dimensional output spaces. T-LVMOGP uses a Lipschitz-regularized neural network to map inputs and output-specific latent variables into a shared embedding space, constructing a flexible multi-output deep kernel. Experiments on climate modeling (10,000+ outputs) and spatial transcriptomics demonstrate that T-LVMOGP achieves superior predictive accuracy and computational efficiency compared to existing methods.
Modeling 10,000+ correlated outputs is now tractable: T-LVMOGP offers a scalable alternative to restrictive low-rank MOGPs by learning a flexible deep kernel in a shared embedding space.
Multi-Output Gaussian Processes (MOGPs) provide a principled probabilistic framework for modelling correlated outputs but face scalability bottlenecks when applied to datasets with high-dimensional output spaces. To maintain tractability, existing methods typically resort to restrictive assumptions, such as employing low-rank or sum-of-separable kernels, which can limit expressiveness. We propose the Transformed Latent Variable MOGP (T-LVMOGP), a novel framework that scales MOGPs to a massive number of outputs while preserving the capacity to capture meaningful inter-output dependencies. T-LVMOGP constructs a flexible multi-output deep kernel by mapping inputs and output-specific latent variables into an embedding space using a Lipschitz-regularised neural network. Combined with stochastic variational inference, our model effectively scales to high-dimensional output settings. Across diverse benchmarks, including climate modelling with over 10,000 outputs and zero-inflated spatial transcriptomics data, T-LVMOGP outperforms baselines in both predictive accuracy and computational efficiency.
