Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces FlashPDE, a novel operator library that enhances the efficiency of Physics-Informed Neural Networks (PINNs) for solving partial differential equations (PDEs) by integrating fused Triton kernels. By replacing traditional PyTorch finite-difference methods with a unified differentiable framework, FlashPDE significantly reduces memory overhead and execution time for large-scale PDE problems. Experimental results demonstrate that FlashPDE achieves up to 37.0x reduction in peak memory usage and up to 2.30x speedup in time-to-solution across various PDE benchmarks, all while maintaining numerical accuracy.
FlashPDE slashes memory usage by 37x and accelerates PDE solutions by 2.3x, revolutionizing the efficiency of neural PDE solvers.
Physics-Informed Neural Networks (PINNs) solve PDEs by incorporating physical constraints into neural-network training, but large-scale problems are limited by automatic-differentiation memory overhead and inefficient execution of grid-based PDE operators. We present FlashPDE, a drop-in fused operator library for grid-based scientific machine learning. FlashPDE replaces fragmented PyTorch finite-difference execution with differentiable Triton kernels. Each operator integrates fused stencil evaluation, an analytic discrete-adjoint backward pass, and boundary-gradient correction within a unified torch.autograd.Function interface. The library provides 14 differentiable PDE operators covering 17 configurations across 1D--3D elliptic, parabolic, and Navier--Stokes systems, while remaining independent of neural architectures and training strategies. Experiments on an NVIDIA A100 GPU show that FlashPDE reduces peak memory usage by up to 37.0x compared with coordinate-based automatic differentiation and reduces CUDA kernel launches by up to 3.5x compared with eager PyTorch finite-difference implementations. Across six representative PDE benchmarks, FlashPDE achieves up to 2.30x end-to-end time-to-solution speedup and up to 19.2x kernel-level acceleration while maintaining numerical agreement with PyTorch finite-difference references. FlashPDE provides a hardware-efficient execution layer that bridges differentiable PDE solvers and GPU-optimized numerical computation within the PyTorch ecosystem.