Track new results across pure and applied mathematics.
Search papers, labs, and topics across Lattice.
This paper establishes rigorous functional-analytic conditions under which stationary points and minimizing sequences of least-squares PDE residual functionals—the core objective in physics-informed neural networks (PINNs)—converge to true solutions. The analysis directly addresses the reliability crisis in scientific ML by proving that minimizing residual loss does not guarantee convergence to physically correct solutions even in well-posed regimes. Crucially, the authors show that smooth spurious critical points occur frequently, zero residuals can correspond to non-viscosity solutions in Hamilton–Jacobi equations, and moving residual jumps in piecewise-smooth trial families can cause sampled training gradients to vanish while the true functional derivative remains nonzero.
Zero residual loss does not guarantee a valid PDE solution: least-squares optimization landscapes harbor smooth spurious minima, converge to non-solutions in transonic conservation laws, and yield falsely vanishing sampled gradients due to moving residual jumps.
Least-squares residual minimization approximates a differential equation through an optimization problem. This paper investigates the conditions required to transition from stationary points and minimizing sequences of the residual functional to the exact solution. Starting from the classical orthogonality relation between the residual and the range of the linearized operator, we study how boundary conditions and parameterized variations determine what can be inferred about the residual at a stationary point. Smooth spurious critical points can occur even for well-posed problems; for linear equations, a compatibility condition yields an exact projection characterization. For a scalar conservation law with transonic boundary data, every minimizing sequence converges to a continuous function that does not solve the equation, even when a stationary entropy shock exists. We give conditions under which approaching this limit forces the parameter norms to diverge. A Hamilton--Jacobi example shows that a function can have zero residual without being the viscosity solution. Favorable results for a viscous model and uniformly convex Monge--Ampère critical points identify conditions that restore the corresponding implications. For piecewise-smooth trial families, the regularity needed to define the residual functional does not by itself justify the sampled gradient used in training. Moving residual jumps can contribute terms absent from that gradient; an explicit example has identically vanishing sampled gradients and a nonzero continuous derivative. Together, these results clarify what stationarity and sampled gradients imply about the residual, and under which conditions minimizing sequences lead to the intended solution.