Search papers, labs, and topics across Lattice.
This paper introduces a physics-informed fine-tuning (PIFT) framework to adapt pre-trained PDE foundation models by incorporating PDE residuals and boundary conditions into the fine-tuning objective. PIFT enables effective adaptation in data-scarce regimes and promotes physical consistency, outperforming data-driven fine-tuning counterparts on an unseen PDE class without requiring PDE solutions for training. A hybrid fine-tuning strategy further improves generalization to out-of-distribution scenarios when minimal training data is available.
Physics-informed fine-tuning lets you adapt PDE foundation models to new tasks without needing any labeled PDE solutions.
Foundation models for partial differential equations (PDEs) have emerged as powerful surrogates pre-trained on diverse physical systems, but adapting them to new downstream tasks remains challenging due to limited task-specific data and distribution shifts. While fine-tuning has proven transformative in natural language processing, best practices for adapting PDE foundation models remain underexplored. Although physics-informed training has successfully trained accurate solvers across a wide range of PDE problems, its potential for fine-tuning data-based foundation models has not been systematically studied. In this work, we introduce a physics-informed fine-tuning framework that adapts pre-trained PDE foundation models by incorporating physical constraints (PDE residuals and boundary conditions) directly into the fine-tuning objective. This enables effective adaptation in data-scarce regimes while promoting physical consistency. We evaluate our method on a downstream task composed of an unseen PDE class and compare it with data-driven finetuning counterparts. Our results demonstrate that physics-informed fine-tuning achieves competitive accuracy without requiring PDE solutions for training. Furthermore, a hybrid fine-tuning strategy yields superior generalization to out-of-distribution scenarios when only minimal training data is available. These findings establish physics-informed fine-tuning as a scalable and data-efficient paradigm, providing a physically interpretable pathway for adapting foundation models in scientific machine learning.
