Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study investigates the training of physics-informed neural operators (PINOs) for solving parametric partial differential equations by integrating physical constraints into the training process. By analyzing various components of the PINO training pipeline, including architecture design and optimization strategies, the authors demonstrate that the Continuous Vision Transformer (CViT) consistently outperforms other architectures in terms of stability and performance. The findings reveal that optimization challenges similar to those in physics-informed neural networks (PINNs) also affect PINOs, but established mitigation strategies can be effectively applied, leading to a robust training framework.
CViT not only excels in stability but also reveals that physics-informed training can rival data-driven methods under optimal conditions.
Physics-informed neural operators (PINOs) aim to learn solution operators for partial differential equations by using the governing physics as supervision, rather than relying solely on paired input-output simulation data. By incorporating physical constraints into the training objective, PINOs combine the cross-instance generalization of neural operators with the data efficiency of physics-informed learning. Despite this promise, how to train PINOs efficiently and robustly remains less well-understood than the training of either data-driven neural operators or physics-informed neural networks (PINNs). To bridge this gap, we examine key components of the PINO training pipeline, including architecture design, optimizer choice, loss balancing, and collocation-point sampling strategy. We study three representative operator backbones, Deep Operator Network (DeepONet), Fourier Neural Operator (FNO), and Continuous Vision Transformer (CViT), across five diverse parametric PDE systems. Our results show that CViT provides consistently strong and stable performance across the considered benchmarks. Beyond architecture, we find that several optimization pathologies previously identified in PINN training naturally arise in PINOs, including gradient conflicts and causal violation. We also find that mitigation algorithms developed for PINNs remain effective in the PINO setting. We further compare physics-informed and data-driven training under different data regimes, revealing that a carefully designed physics-informed training pipeline can match, and in some cases, outperform purely data-driven neural operators. Taken together, these findings provide a systematic empirical understanding of the optimization challenges in PINO training and inform a practical pipeline for efficient and robust physics-informed operator learning. Code and data are available at https://github.com/NanxiiChen/PI-CViT.