Search papers, labs, and topics across Lattice.
This paper introduces a novel approach to continual learning in large language models by employing Sparse Autoencoders (SAEs) for activation regularization instead of traditional weight-space methods like Elastic Weight Consolidation (EWC). The authors argue that EWC's underperformance stems from its inability to effectively isolate knowledge due to the polysemantic nature of LLMs, leading to a new loss function that balances stability and plasticity in the activation space. Experimental results on the TRACE and MedCL benchmarks demonstrate that this SAE-guided method outperforms EWC and other traditional approaches, highlighting the importance of using a monosemantic feature dictionary for improved continual learning performance.
Regularizing in the activation space with Sparse Autoencoders leads to superior continual learning performance in large language models, outperforming traditional weight-space methods.
Weight-space regularization methods such as Elastic Weight Consolidation (EWC) are the standard approach to catastrophic forgetting in continual learning. However, those methods tend to underperform when applied to large language models. We argue that such underperformance can be partly explained by the ``polysemantic'' nature of large language models: per-weight importance estimates utilized by EWC-style regularization are too coarse and cannot isolate the knowledge that needs protection. In this paper, we propose regularizing instead in the model's activation space, using pretrained Sparse Autoencoders (SAEs) as a monosemantic feature dictionary. From the perspective of constrained optimization, we derive a new loss function that uses the SAE feature dictionary to explicitly balance stability and plasticity, and show that EWC is a special case in the one-sided weight-space penalty setting. Unlike replay-based methods that store or revisit examples from earlier tasks, our method requires no previous-task data after mask construction: current-task data is used to compute a compact SAE feature mask, and only this mask is retained for later training. Further, since the feature space has significantly lower dimensionality than the parameter space, the proposed method is more memory efficient. On the TRACE and MedCL continual learning benchmarks, the method achieves the strongest result among approaches without introducing task-specific architectural components, also surpassing traditional weight-space regularization methods like EWC. Beyond performance comparisons, we provide empirical evidence for the polysemanticity thesis: task-relevant representations are linearly separable in the SAE feature basis but indistinguishable from chance in the weight basis, and weight-space protection is nearly non-selective at the concept level.
