Search papers, labs, and topics across Lattice.
This paper integrates Lagrangian Neural Networks (LNNs) into a Dyna-based Model-Based Reinforcement Learning (MBRL) framework to improve the accuracy and generalization of learned dynamics models. The LNN enforces a Lagrangian structure, ensuring adherence to physical laws, and is trained using both stochastic gradient-based and state-estimation-based optimizers. Results demonstrate the effectiveness of the LNN-based Dyna framework, with state-estimation-based training showing faster convergence.
By enforcing physical laws, Lagrangian Neural Networks can significantly improve the accuracy and generalization of dynamics models within Model-Based Reinforcement Learning.
Model-based reinforcement learning (MBRL) is sample-efficient but depends on the accuracy of the learned dynamics, which are often modeled using black-box methods that do not adhere to physical laws. Those methods tend to produce inaccurate predictions when presented with data that differ from the original training set. In this work, we employ Lagrangian neural networks (LNNs), which enforce an underlying Lagrangian structure to train the model within a Dyna-based MBRL framework. Furthermore, we train the LNN using stochastic gradient-based and state-estimation-based optimizers to learn the network's weights. The state-estimation-based method converges faster than the stochastic gradient-based method during neural network training. Simulation results are provided to illustrate the effectiveness of the proposed LNN-based Dyna framework for MBRL.
