Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
This paper introduces a novel predefined-time integral reinforcement learning (IRL) framework for optimal control of unknown nonlinear systems by first approximating the unknown drift with an RBF neural network and an online identification law. The core innovation is incorporating a designer-specified convergence time directly into the control objective via inverse-optimal control, ensuring the optimal policy achieves predefined-time stabilization. The approach utilizes a second RBF network for value function approximation and a critic update law that guarantees predefined-time convergence of critic weights, with finite informative data stored in a replay buffer to avoid persistent excitation.
Achieve guaranteed state convergence within any designer-specified deadline for unknown nonlinear systems, even with limited data.
This paper develops a new predefined-time integral reinforcement learning framework for optimal control of unknown nonlinear systems. The unknown drift is first approximated by a radial basis function (RBF) neural network, together with a data-driven online identification law for updating the corresponding neural weights. After the identifier converges to a sufficiently small neighborhood of the true dynamics, the learned model is incorporated into the integral reinforcement learning (IRL) problem. Unlike conventional reinforcement-learning-based optimal control, the desired convergence time is introduced directly into the control objective: a Lyapunov function and its prescribed decay behavior are specified by the designer, and inverse-optimal control is then used to construct a compatible running cost whose optimal policy inherits the predefined-time stabilization property. The value function is approximated by a second RBF neural network, and a new critic update law is developed to impose predefined-time convergence on the critic weights. Finite informative learning data are stored in a replay buffer and reused during the critic update, thereby avoiding the need for persistent excitation throughout the closed-loop operation. Theoretical analysis proves that the critic-weight error enters a prescribed residual set within the allocated learning horizon, while the closed-loop state reaches a small neighborhood of the origin within the overall designer-specified deadline. Numerical simulations on an unknown nonlinear system verify accurate drift reconstruction, predefined-time critic learning, and closed-loop convergence.