Search papers, labs, and topics across Lattice.
This paper introduces a unified multi-dimensional training-priority weighting framework for physics-informed neural networks (PINNs) that aligns training with the physical information propagation paths of partial differential equations (PDEs). By addressing the inconsistency in how residuals are treated across different regions and constraints, the authors leverage neural tangent kernel dynamics to establish a theoretical foundation for their approach. The proposed method significantly enhances convergence behavior and prediction accuracy in benchmark cases, demonstrating its effectiveness without altering the network architecture or incurring substantial computational overhead.
Training physics-informed neural networks with a unified priority framework can dramatically improve convergence and accuracy by respecting the physical information flow.
Physics-informed neural networks (PINNs) have shown promise for solving partial differential equations (PDEs); however, their synchronous optimization treats residuals of different regions and constraints equally, which is inconsistent with the progressive "from source to response" physical information propagation path, degrading training stability and accuracy. Existing causal training methods focus mainly on the temporal dimension, lacking a unified characterization of spatial and boundary dimensions. To address this, we define a unified class of training priorities according to the physical information propagation path: premise regions should be learned before dependent regions; temporal, spatial, and boundary priorities are instances of this principle. Using neural tangent kernel (NTK) dynamics, we theoretically analyze why standard PINNs do not obey this priority: their residual convergence order is governed by the NTK spectrum and is independent of the propagation path. Accordingly, we propose a unified multi-dimensional priority-constraint framework that partitions the domain along the propagation path and constructs negative-exponential residual weights, converting the physical propagation order into a training priority. For cases with coexisting priorities, we introduce a directional compatibility coefficient to clarify that "orthogonal directions can be coupled multiplicatively in synergy, whereas coaxial opposite directions cannot." Benchmark cases show that this method consistently improves the convergence behavior and prediction accuracy of PINNs on problems with clear propagation paths or constraint-dominated structures, without modifying the network architecture and with controllable additional computational cost.
Tsinghua AI