Search papers, labs, and topics across Lattice.
This paper introduces a hierarchical rank-evolving (HRE) representation for tensor-based physics-informed neural networks (T-PINNs) that automates the determination of tensor ranks, addressing the limitations of pre-specified low-rank decompositions. By decomposing multivariate functions into a small-scale inner tensor with univariate functions, the HRE approach captures the underlying structures more effectively, facilitating practical applications in complex physics problems. Extensive numerical experiments show that HRE-PINNs significantly outperform existing methods, enhancing accuracy across various challenging scenarios, including high-dimensional and nonlinear problems.
Automating rank determination in tensor-based neural networks could revolutionize their application in complex physics simulations.
Recently, tensor-based physics-informed neural networks (T-PINNs) have received increasing attention. However, existing T-PINNs still face a fundamental challenge: they mainly rely on pre-specified low-rank tensor decompositions with manually tuned ranks, which limits their ability to capture the underlying structures of multivariate solution functions and hinders their practical deployment. To address this challenge, we propose a hierarchical rank-evolving (abbreviated as HRE) representation for multivariate functions, which endows us to faithfully capture the underlying structure of the targeted multivariate function accompanying with automatic rank determination. Concretely, in the hierarchical design of HRE representation, the target multivariate function is decomposed as a small-scale inner tensor with a set of univariate functions along each mode, where a customized tensor network decomposition can be readily deployed to capture the underlying structure of the small-scale inner tensor. In HRE representation, the crucial hyperparameters, ranks, can be adaptively revealed during the decomposition, freeing us from manual rank tuning and making HRE practically applicable to real-world problems. Besides, we build the HRE-PINNs correspondingly. Extensive numerical experiments, including high-dimensional static problems (Helmholtz equation and Poisson equation), nonlinear time-dependent problems (Klein-Gordon equation), and complex fluid-dynamics problems (flow mixing equation and Navier-Stokes equation), demonstrate that HRE-PINNs consistently outperform existing state-of-the-art approaches in terms of accuracy.
