Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
RiccatiSSM formulates sequence modeling through input-conditioned Riccati differential equations whose discrete-time flows yield fractional-linear Möbius transformations. By exploiting the property that Möbius maps compose associatively via $2\times 2$ matrix multiplication, the architecture evaluates state-dependent nonlinear dynamics in a single parallel scan without the iterative linearizations required by prior nonlinear recurrent models. Supported by a constrained parameterization that guarantees contractive, pole-free dynamics, the model matches the predictive accuracy of nonlinear baselines while cutting runtime by 22–33% across long-sequence tasks.
Nonlinear recurrent dynamics no longer require slow, iterative linearizations to parallelize: input-conditioned Riccati flows compose exactly via $2 \times 2$ Möbius matrix multiplication in a single associative scan.
State space models (SSMs) achieve efficient sequence processing because their affine state updates are closed under composition and can therefore be evaluated with an associative parallel scan. Nonlinear recurrent models can provide richer, state-dependent dynamics, but generally lose this compositional structure: parallel evaluation then requires iterative methods that repeatedly linearize and scan the recurrence. We ask, what state-dependent nonlinear dynamics can be designed to remain exactly composable? We answer by introducing RiccatiSSM, a nonlinear SSM, in which each state dimension follows an input-conditioned Riccati differential equation. Its quadratic state dependence makes the local Jacobian explicitly state-dependent, while its exact per-step flow under piecewise-constant inputs is a Möbius transformation. Since Möbius maps are closed under composition and compose through $2\times 2$ matrix multiplication, the complete nonlinear state trajectory can be evaluated exactly with a single associative parallel scan, without iterative linearization. We further derive a constrained parameterization that ensures bounded, contractive dynamics, and avoids poles in the fractional-linear state update. Across long-sequence classification, regression, and forecasting tasks, RiccatiSSM achieves competitive predictive performance while reducing runtime by $22{-}33\%$ compared to the nonlinear LrcSSM under matched architectures. These results demonstrate that state-dependent nonlinear dynamics can retain exact composability and be evaluated efficiently within a single parallel scan.
MIT CSAIL