Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
To resolve catastrophic forgetting in task-agnostic Class Incremental Learning (Class-IL), this work evaluates dynamic layer-width expansion guided by a normalized loss criterion paired with persistent key-value memory attention. By scaling capacity based on empirical representational demand rather than predefined schedules, the model accommodates new classes without requiring task boundaries or oracle task identifiers at inference. Evaluated on Split MNIST and Split CIFAR-100, the approach consistently outperforms fixed-capacity architectures—especially when combined with A-GEM and LwF—with the joint expansion-attention architecture yielding the strongest retention.
Continual learners no longer need oracle task IDs to dynamically scale capacity, as loss-driven width expansion coupled with persistent key-value attention prevents catastrophic forgetting across unsegmented task streams.
Class Incremental Learning (Class-IL) requires models to learn new classes over time while preserving previously acquired knowledge without access to past data or task identity. This setting intensifies the stability-plasticity dilemma and makes catastrophic forgetting a central challenge. Existing approaches include regularization, knowledge distillation, replay, and architectural expansion. However, many expansion methods rely on explicit task identifiers or predefined growth strategies, limiting their applicability when task boundaries are unavailable at inference time. This work proposes a dynamic width expansion method that increases the number of neurons within existing layers according to a normalized loss criterion, without requiring task-specific information. An attention mechanism with persistent key-value memory is also incorporated to stabilize feature representations and reduce interference between previously learned and newly introduced classes. The approach is evaluated on Split MNIST and Split CIFAR-100 under the standard Class-IL protocol. Experiments compare fixed-capacity and dynamically expanding architectures, both with and without attention, combined with established continual learning methods including EWC, LwF, and A-GEM. Results show that progressive width expansion consistently improves performance over fixed architectures, particularly when combined with functional methods and A-GEM. The combination of width expansion and attention provides the most consistent gains. Overall, dynamic width expansion based on representational demand provides an effective and flexible strategy for Class-IL, although uncontrolled growth may increase overfitting and computational cost.