Search papers, labs, and topics across Lattice.
This paper investigates the emergence of low-dimensional dominant manifolds in Reservoir Computing (RC) networks trained for temporal forecasting. By analyzing a simplified linear RC model, the authors establish a direct link between the dimensionality/structure of these dominant modes and the intrinsic dimensionality/information content of the training data. Specifically, they show that for data from autonomous dynamical systems, the dominant modes approximate Koopman eigenfunctions, connecting RC to Dynamic Mode Decomposition.
Reservoir Computing's black box is cracked open, revealing that its dynamics approximate Koopman eigenfunctions of the training data's underlying system.
Understanding how training shapes the geometry of recurrent network dynamics is a central problem in time-series modeling. We study the emergence of low-dimensional dominant manifolds in the training of Reservoir Computing (RC) networks for temporal forecasting tasks. For a simplified linear and continuous-time reservoir model, we link the dimensionality and structure of the dominant modes directly to the intrinsic dimensionality and information content of the training data. In particular, for training data generated by an autonomous dynamical system, we relate the dominant modes of the trained reservoir to approximations of the Koopman eigenfunctions of the original system, illuminating an explicit connection between reservoir computing and the Dynamic Mode Decomposition algorithm. We illustrate the eigenvalue motion that generates the dominant manifolds during training in simulation, and discuss generalization to nonlinear RC via tangent dynamics and differential p-dominance.
