Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces the finite-horizon Green's operator as a novel tool to analyze computation organization and reuse in recurrent neural networks by mapping global first-order perturbation responses. By analyzing reductions of this operator, the authors reveal structured reuse of computational motifs across tasks and identify causal pathways that emerge during training in a multitask recurrent network. This approach offers a global response geometry for understanding learned dynamical computation, complementing existing analyses focused on activity geometry or local dynamics.
The Green's operator reveals how computation is globally routed and reused across tasks and time in recurrent networks, offering a new lens beyond activity geometry.
How is computation organized and reused across tasks and time in a trained recurrent network? Most analyses emphasize the geometry of neural activity, dynamical motifs, or local perturbation growth. We instead study the network's global first-order perturbation response. The finite-horizon Green's operator maps perturbations at each source along a trajectory to their downstream state-space responses and therefore directly represents perturbation routing. Simple reductions of this operator provide task-to-task and time-to-time views of the same computation, while matrix-free products make these views accessible without constructing the full operator. In a flexible multitask recurrent network, task reductions reveal structured reuse of known computational motifs, while temporal reductions reveal causal pathways and how they emerge during training. Our main point is simple: the Green's operator provides a global response geometry for mapping the organization of learned dynamical computation.