Search papers, labs, and topics across Lattice.
This paper introduces Operator Boosting, a novel stagewise residual-learning framework that constructs compact neural-operator surrogates for partial differential equations (PDEs) directly, bypassing the need for large model training followed by compression. By training small neural operators on residual fields and applying validation-selected shrinkage, the method achieves significant reductions in parameter count (72-95%) while enhancing accuracy across various PDE benchmarks. The results indicate that Operator Boosting can lead to empirical Pareto improvements in accuracy and efficiency, with 21 out of 30 tested configurations showing positive accuracy gains compared to traditional monolithic models.
Operator Boosting achieves up to 95% reduction in parameters while enhancing accuracy in neural PDE surrogates, challenging the conventional approach of large model training.
Neural operators are widely used as surrogate solution maps for partial differential equations (PDEs), but full-size models can be costly to store, deploy, and evaluate in many-query scientific workflows. This work introduces Operator Boosting, a stagewise residual-learning framework for constructing compact neural-operator surrogates directly, rather than training a large model and compressing it afterward. Starting from the empirical mean predictor in normalized output coordinates, the method trains a sequence of tiny same-family neural operators on residual fields and incorporates each correction through validation-selected shrinkage. We instantiate the framework with Fourier neural operators (FNOs), DeepONets, and convolutional neural operators (CNOs), and compare boosted tiny stacks against full-size monolithic baselines across one-, two-, and three-dimensional PDE benchmarks from PDEBench, APEBench, and The Well. Across 30 dataset-architecture pairs, 21 show positive mean accuracy gains and 17 have positive confidence intervals, while all boosted stacks reduce trainable parameter count by approximately 72-95%. Best-model comparisons show empirical Pareto improvements on 7 of 10 completed PDE benchmarks, including two-dimensional Navier-Stokes, shallow-water dynamics, Darcy flow, one-dimensional transport and reaction systems, and three-dimensional compressible Navier-Stokes. These results show that Operator Boosting often improves the empirical accuracy-parameter Pareto frontier of neural PDE surrogates, while also exposing PDE- and architecture-dependent regimes where residual boosting fails to offset compression.
