Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper establishes the global convergence properties of the FilterDDP algorithm, an extension of the discrete-time differential dynamic programming (DDP) method that accommodates nonlinear constraints in both states and controls. By employing a line-search filter procedure, FilterDDP computes trial points through a novel backward recursion and forward simulation approach, rather than the conventional damped Newton step. The authors demonstrate that this method retains the essential properties of a Newton step, ensuring global convergence for a specific class of constrained optimal control problems.
FilterDDP achieves global convergence for constrained optimal control problems by leveraging a novel backward-forward computation method that rivals traditional Newton steps.
In this article, we establish the global convergence properties of the FilterDDP algorithm, which extends the discrete-time differential dynamic programming (DDP) algorithm of Mayne and Jacobson [\emph{International Journal of Control}, 3, (1966), pp. 85-95] to handle nonlinear constraints over states and controls, in addition to the dynamics. FilterDDP adopts a line-search filter procedure for step acceptance. However, instead of a damped Newton step applied in the general nonlinear programming setting, the computation of a trial point involves applying a backward recursion and a forward simulation. We establish the global convergence of FilterDDP by showing that for a subset of constrained optimal control problems, the this backward-forward procedure satisfies the same properties as a Newton step for the purpose of establishing global convergence of a line-search filter method, following the analysis of Wächter and Biegler [\emph{SIAM Journal on Optimization}, 16 (2005), pp. 1-31].