Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper establishes the global convergence of neural networks trained via the Deep Galerkin Method (DGM) and Physics Informed Neural Networks (PINNs) for a specific class of semi-linear partial differential equations (PDEs). By rigorously proving that these networks will converge to the true PDE solution despite the non-convexity of the objective function, the authors address a critical gap in the mathematical understanding of these widely-used methods. The key result demonstrates that, under certain conditions, gradient descent can effectively lead to global solutions rather than local minima, enhancing the reliability of DGM and PINN approaches in scientific machine learning.
Neural networks trained with DGM and PINNs can reliably converge to the true solutions of semi-linear PDEs, overcoming the pitfalls of local minima.
The Deep Galerkin Method (DGM) and Physics Informed Neural Networks (PINNs) have become widely-used methods for solving partial differential equations (PDEs) in the rapidly growing field of scientific machine learning. In these methods, a neural network is trained to approximate the PDE solution by using (stochastic) gradient descent to minimize the PDE residual of the neural network. Due to the non-convexity of the PDE residual objective function, the trained neural network may, in principle, only converge to a local minimizer of the objective function (which would not be a solution of the PDE). Therefore, there is a longstanding question regarding the mathematical foundations of these algorithms, and it is highly valuable to establish that the trained neural network will converge to the PDE solution. For a class of semi-linear PDEs (nonlinear in the solution and its first derivative), we prove that neural networks trained with gradient descent to minimize the PDE residual objective function will converge to the PDE solution.