Search papers, labs, and topics across Lattice.
This paper introduces a novel training method for Hamiltonian Neural Networks (HNNs) that utilizes implicit symplectic integrators to efficiently learn Hamiltonians from noisy observations. By leveraging symplectic discretizations of the adjoint system, the authors demonstrate a significant reduction in computational costs while maintaining the fidelity of energy conservation in chaotic systems. Experimental results show that their approach not only enhances system identification but also improves the accuracy of learned Hamiltonians through backward error analysis.
Efficiently training Hamiltonian Neural Networks can now be achieved even under noisy conditions, preserving energy conservation without excessive computational overhead.
Hamiltonian Neural Networks (HNNs) integrate physical priors into neural models by learning a system's Hamiltonian, improving generalization and sample efficiency. Identifying the system Hamiltonian from noisy observations of state variables is a challenging task. For simulations to faithfully reflect the long-term behavior of Hamiltonian systems, especially energy conservation, it is essential to use symplectic integrators, which preserve the system's geometric structure. This fidelity comes at a cost: implicit symplectic integrators are more computationally intensive and make backpropagation through the ODE solver non-trivial. However, by leveraging the fact that symplectic discretizations of the adjoint system yield the same sensitivities associated by backpropagation, we obtain an efficient method of training the Neural Network parameters. In our work, we explore this alternate method of HNN training under noisy observation of trajectories with our HNN model based on an implicit symplectic integrator. Computationally, a predictor-corrector based ODE solver and fixed point iteration help to mitigate the computational cost of the implicit timestepping, resulting in more efficient generation of gradient updates. We showcase the numerical advantage, in experiments, in system identification and energy preservation on a range of non-separable, chaotic systems and the efficient computation and memory complexity of our method. We also observe that the post-processing of the learned Hamiltonian using backward error analysis yields a modified Hamiltonian that is a more accurate approximation of the true Hamiltonian without the need to use more accurate discretizations of the flow map.
