Search papers, labs, and topics across Lattice.
This paper introduces a nonlinear separation principle ensuring global exponential stability for interconnected contracting state-feedback controllers and observers in recurrent neural networks (RNNs). It derives linear matrix inequality (LMI) conditions guaranteeing contractivity for firing rate and Hopfield network architectures, revealing that continuous-time models with monotone activations maximize admissible weight space. The framework is then applied to output reference tracking for RNN-modeled plants and used to design implicit neural networks with competitive accuracy on image classification tasks.
Guaranteeing stability in interconnected RNN control systems is now tractable, unlocking potential for robust control of complex dynamical systems using neural network models.
This paper investigates continuous-time and discrete-time firing-rate and Hopfield recurrent neural networks (RNNs), with applications in nonlinear control design and implicit deep learning. First, we introduce a nonlinear separation principle that guarantees global exponential stability for the interconnection of a contracting state-feedback controller and a contracting observer, alongside parametric extensions for robustness and equilibrium tracking. Second, we derive sharp linear matrix inequality (LMI) conditions that guarantee the contractivity of both firing rate and Hopfield neural network architectures. We establish structural relationships among these certificates-demonstrating that continuous-time models with monotone non-decreasing activations maximize the admissible weight space, and extend these stability guarantees to interconnected systems and Graph RNNs. Third, we combine our separation principle and LMI framework to solve the output reference tracking problem for RNN-modeled plants. We provide LMI synthesis methods for feedback controllers and observers, and rigorously design a low-gain integral controller to eliminate steady-state error. Finally, we derive an exact, unconstrained algebraic parameterization of our contraction LMIs to design highly expressive implicit neural networks, achieving competitive accuracy and parameter efficiency on standard image classification benchmarks.
