Search papers, labs, and topics across Lattice.
This study investigates the mechanisms of forgetting in continual learning (CL) systems using a controlled synthetic framework that isolates factors affecting representation retention. By analyzing retention dynamics through sparse dynamical relations and task-level effective rank, the authors reveal that superposition increases over time with transient dips at task boundaries, and that higher feature sparsity can enhance representational capacity without necessarily leading to forgetting. The findings challenge the prevailing notion that increased superposition directly correlates with greater forgetting, highlighting the complex interplay between representation strength, overlap, and capacity allocation.
Superposition in continual learning doesn't always lead to forgetting; instead, strong representations can mitigate memory loss even in sparse settings.
Continual learning (CL) systems often forget previously acquired knowledge, yet the mechanisms driving forgetting remain hard to isolate in practice because real datasets entangle many factors. We present a controlled, toy-world framework that makes these mechanisms observable and testable. Using a synthetic generator-separator pipeline, we define ground-truth latent features, build tasks with tunable sparsity and overlap, and introduce measurable quantities for representation strength and superposition (directional overlap among features). We then study retention dynamics-the temporal change of representation strength by fitting sparse dynamical relations (via SINDy) between retention, superposition, and exposure history. A complementary task-level analysis based on effective rank characterizes how representational capacity is allocated across tasks. Our controlled experiments yield three takeaways. (1) Superposition tends to increase over time with transient dips at task boundaries, suggesting boundary-specific interference rather than steady drift. (2) Higher feature sparsity induces more superposition yet does not inevitably cause forgetting; when representations remain strong, forgetting can be reduced despite overlap. (3) Task-level effective rank grows with sparsity, indicating broader capacity usage under sparse regimes. Together, these results nuance the common intuition that more superposition leads to more forgetting by showing that overlap interacts with representation strength and capacity allocation. Our toy analysis provides falsifiable hypotheses and diagnostic tools for CL.
