Search papers, labs, and topics across Lattice.
This paper addresses the challenge of catastrophic forgetting in continual learning when adapting pre-trained models to new domains with large distribution shifts. They propose Stochastic Continual Learner with MemoryGuard Supervisory Mechanism (SCL-MGSM), which uses a data-guided approach to construct a random projection layer (RPL) that aligns pre-trained representations with downstream tasks. By progressively selecting target-aligned random bases, SCL-MGSM creates a compact and expressive RPL, improving numerical stability and achieving state-of-the-art performance on exemplar-free class incremental learning benchmarks.
Random projections in continual learning don't have to be random: carefully guiding them with target-aligned data beats the SOTA.
Recent paradigms in Random Projection Layer (RPL)-based continual representation learning have demonstrated superior performance when building upon a pre-trained model (PTM). These methods insert a randomly initialized RPL after a PTM to enhance feature representation in the initial stage. Subsequently, a linear classification head is used for analytic updates in the continual learning stage. However, under severe domain gaps between pre-trained representations and target domains, a randomly initialized RPL exhibits limited expressivity under large domain shifts. While largely scaling up the RPL dimension can improve expressivity, it also induces an ill-conditioned feature matrix, thereby destabilizing the recursive analytic updates of the linear head. To this end, we propose the Stochastic Continual Learner with MemoryGuard Supervisory Mechanism (SCL-MGSM). Unlike random initialization, MGSM constructs the projection layer via a principled, data-guided mechanism that progressively selects target-aligned random bases to adapt the PTM representation to downstream tasks. This facilitates the construction of a compact yet expressive RPL while improving the numerical stability of analytic updates. Extensive experiments on multiple exemplar-free Class Incremental Learning (CIL) benchmarks demonstrate that SCL-MGSM achieves superior performance compared to state-of-the-art methods.
