Track genomics, neuroscience and molecular biology.
Search papers, labs, and topics across Lattice.
This paper investigates how increasing latent dimension impacts autoregressive dynamics learning by analyzing the eigenstructure of learned Koopman operators. Using relative residuals to identify spurious eigenpairs, the authors demonstrate that for bounded operators, minimal residuals converge to full-space counterparts as learned dictionary spaces approximate the observable space. Across six chaotic systems, a spectral-residual loss objective consistently outperformed a latent-prediction loss, achieving lower rollout errors and longer valid prediction times, suggesting Koopman spectral reliability explains dimension-scaling benefits.
Spectral analysis reveals that increasing latent dimensions in Koopman autoencoders improves dynamics learning by concentrating learned eigenvalues in low-residual regions, not just by reducing one-step prediction error.
In deep learning, approximation theory motivates increasing representation size. We ask whether this benefit extends to dynamics learning through autoregressive prediction. We analyze the learned time evolution through the eigenstructure of Koopman operators, using relative residuals to detect spurious eigenpairs arising even as one-step error falls. For bounded Koopman operators, we show that minimal residuals over learned dictionary spaces converge pointwise to their full-space counterparts as these spaces approximate the observable space in $L^2$. Our hypothesis is that Koopman spectral reliability helps explain how consistently rollout error decreases with increasing dimension. We compare two models of a shared Koopman autoencoder trained alternately for reconstruction and latent evolution, using latent-prediction loss (one-step prediction errors in latent coordinates) or spectral-residual loss (relative residuals of candidate eigenpairs). Across six chaotic systems, both models reduced median windowed rollout error from smallest to largest dimension. The spectral-residual model achieved lower medians than the latent-prediction model for all systems and dimensions, and its median fell by a larger factor in every system. Its median decreased monotonically with dimension in four systems, against one for latent prediction. Against four baseline families, its mean valid prediction times were nearly always longer. At the largest dimension under two-stage training, we compared eigenvalue positions with each learned dictionary's residual contours. Spectral-residual eigenvalues concentrated in low-residual regions, whereas latent-prediction eigenvalues also appeared in high-residual regions, consistent with the hypothesis.