Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper explores algorithmic stability to establish out-of-sample bounds in learning-enabled dynamical systems, particularly in data-driven optimization and feedback control. By modeling sample replacement as an exogenous disturbance and employing dissipativity arguments, the authors derive a matrix inequality-based certificate that quantifies the generalization capabilities of learning dynamics. The findings not only recover classical results for gradient descent but also extend to momentum-based methods and data-driven control, providing a robust framework for comparing generalization performance.
A novel framework reveals how algorithmic stability can certify and optimize generalization in learning-enabled dynamical systems, bridging classical and modern optimization techniques.
By focusing on algorithmic stability as a means of establishing out-of-sample bounds, we provide a system-theoretic interpretation of generalization in learning-enabled dynamical systems arising in data-driven optimization and feedback control approximation. Given two neighboring datasets, we specifically model sample replacement as an exogenous disturbance acting on a sensitivity system, while the incremental behavior of the data-dependent operator is encoded through an integral quadratic constraint. By relying on dissipativity arguments, we establish a matrix inequality-based certificate and a uniform stability bound that separates the one-sample sensitivity of the learned operator, and an algorithm-dependent dynamical gain. The latter can then be optimized, offering a tractable tool for certifying and comparing generalization capabilities of learning dynamics. We show that our results recover classical ones for gradient descent, apply naturally to momentum-based methods such as heavy-ball and Nesterov acceleration, and extend to data-driven control.