Search papers, labs, and topics across Lattice.
This paper introduces a Neural Galerkin Normalizing Flow (NGNF) framework to approximate the transition probability density function (TPDF) of diffusion processes by solving the Fokker-Planck equation. NGNF leverages normalizing flows to ensure structure preservation and automatic satisfaction of positivity and mass conservation constraints, while extending Neural Galerkin schemes to derive ODEs for the time evolution of the normalizing flow's parameters. Experiments demonstrate that NGNF captures key features of the true solution and offers a cost-effective surrogate model for many-query problems associated with stochastic differential equations.
Unlock faster diffusion model analysis: Neural Galerkin Normalizing Flows offer a cost-effective surrogate for transition probability density functions, outperforming direct PDE solving.
We propose a new Neural Galerkin Normalizing Flow framework to approximate the transition probability density function of a diffusion process by solving the corresponding Fokker-Planck equation with an atomic initial distribution, parametrically with respect to the location of the initial mass. By using Normalizing Flows, we look for the solution as a transformation of the transition probability density function of a reference stochastic process, ensuring that our approximation is structure-preserving and automatically satisfies positivity and mass conservation constraints. By extending Neural Galerkin schemes to the context of Normalizing Flows, we derive a system of ODEs for the time evolution of the Normalizing Flow's parameters. Adaptive sampling routines are used to evaluate the Fokker-Planck residual in meaningful locations, which is of vital importance to address high-dimensional PDEs. Numerical results show that this strategy captures key features of the true solution and enforces the causal relationship between the initial datum and the density function at subsequent times. After completing an offline training phase, online evaluation becomes significantly more cost-effective than solving the PDE from scratch. The proposed method serves as a promising surrogate model, which could be deployed in many-query problems associated with stochastic differential equations, like Bayesian inference, simulation, and diffusion bridge generation.
