Search papers, labs, and topics across Lattice.
This paper addresses the limitations of classical probabilistic inference methods in high-dimensional Bayesian inverse problems by introducing a convex approximation framework for neural likelihood-based approaches. By reformulating the training objective to incorporate un-normalized potentials, the authors demonstrate that the learning problem becomes strictly convex, ensuring convergence of empirical minimizers to the true likelihood as sample sizes increase. Numerical experiments validate the effectiveness of this method in applications such as deblurring and non-linear PDE-based imaging problems, showcasing its potential for improving model accuracy in complex scientific scenarios.
By transforming the training of neural likelihood surrogates into a strictly convex problem, this framework guarantees convergence to the true likelihood, overcoming traditional modeling limitations.
Many problems in science and engineering are difficult to model accurately, either due to unknown physical mechanisms, poorly quantified measurement uncertainty, or prohibitive computational costs of high-fidelity simulations. These challenges limit the applicability of classical probabilistic inference methods such as Markov chain Monte Carlo, especially in high-dimensional Bayesian inverse problems. As data from scientific experiments become increasingly available, machine learning methods offer a flexible alternative to explicit parametric modelling. We study neural likelihood approximation, where the goal is to learn the likelihood function directly from data without explicit knowledge of the underlying data-generating process. A common approach trains likelihood surrogates by minimizing the Kullback-Leibler divergence between the true posterior and an approximate posterior, which is equivalent to minimizing the expected negative log-likelihood. This work improves the theoretical foundations of neural likelihood approximation by alleviating limitations of restrictive model classes: we show that, by working with un-normalized potentials and folding normalization into the training objective, the resulting learning problem is strictly convex. We show that empirical minimizers of the resulting data-driven objective converge to the true likelihood as the sample size grows. Numerical experiments for the neural likelihood approximation are conducted for a deblurring and a non-linear PDE based imaging problem.
