Search papers, labs, and topics across Lattice.
This paper introduces a data-driven method for approximating value functions in deterministic optimal control problems by leveraging Hessian information derived from the Pontryagin Maximum Principle. By solving the optimality system from multiple initial conditions, the authors generate training data that includes values, gradients, and Hessians, which are then used in a weighted least-squares regression framework. The results demonstrate that incorporating second-order data significantly enhances approximation accuracy and reduces sample complexity, achieving up to an order-of-magnitude reduction in training samples compared to traditional methods.
Incorporating Hessian information can reduce the sample complexity of value function approximation by an order of magnitude in high-dimensional control problems.
A data-driven method is developed for approximating value functions in deterministic optimal control problems with nonlinear control-affine dynamics. The Pontryagin Maximum Principle optimality system is solved from multiple initial conditions to generate training data consisting of values, gradients, and Hessians of the value function, where Hessian information is obtained from a matrix Riccati equation along optimal trajectories. These quantities augment a weighted least-squares regression over sparse polynomial bases on hyperbolic cross index sets, with gradients and Hessians contributing additional linear equations per sample and substantially reducing sample complexity compared to value-only regression. Feedback laws are recovered analytically from the learned value function. In high dimensions, a partial Hessian strategy controls the cost of data generation. The approach is validated on problems of increasing state dimension, where second-order data augmentation is shown to improve approximation accuracy and closed-loop performance, with up to an order-of-magnitude reduction in the number of training samples required relative to lower-order methods.
