Search papers, labs, and topics across Lattice.
This paper introduces a geometric framework for learning both deterministic and stochastic forced Hamiltonian systems using neural networks, grounded in the Lagrange-d'Alembert principle and variational integrators. The authors develop Generalized Forced Hamiltonian Neural Networks (GFHNNs) and establish a convergence theorem for first-order methods, demonstrating that these networks preserve the structure of Hamiltonian dynamics. Numerical experiments show that GFHNNs and their parametric extension (PGFHNNs) achieve superior long-term stability and accuracy with less training data compared to traditional residual neural networks.
GFHNNs can outperform conventional neural networks in learning Hamiltonian dynamics while requiring significantly less training data.
We develop a geometric framework for learning deterministic and stochastic forced Hamiltonian systems with neural networks. Motivated by the Lagrange-d'Alembert principle and the theory of variational integrators, we introduce the notion of a Lagrange-d'Alembert map and establish a $C^r$ convergence theorem for first-order one-step methods. Building on these results, we propose Generalized Forced Hamiltonian Neural Networks (GFHNNs), a class of structure-preserving neural networks obtained by concatenating Lagrange-d'Alembert-Euler maps, and prove a universal approximation theorem for this architecture. We further extend the framework to parameter-dependent systems, leading to Parametric Generalized Forced Hamiltonian Neural Networks (PGFHNNs). By interpreting the multiple Stratonovich integrals appearing in the Stratonovich-Taylor expansion as parameters, the same framework can be applied to stochastic forced Hamiltonian systems whenever information about the underlying Wiener process is available. Our numerical experiments demonstrate that the proposed geometric architectures provide significantly improved long-time stability and accuracy compared to non-geometric residual neural networks, while requiring substantially less training data to achieve a comparable level of performance.
