Search papers, labs, and topics across Lattice.
This paper introduces CIRCLE, a novel class-incremental classifier that utilizes fixed bidirectional two-dimensional reservoir features for cold-start exemplar-free learning, avoiding the pitfalls of both drift-compensation and frozen-backbone methods. By employing streaming linear discriminant analysis heads and feature ensembles, CIRCLE achieves a tunable bias-variance tradeoff, enabling efficient sample-wise training without the need for replay or backbone backpropagation. Experimental results demonstrate that CIRCLE significantly outperforms existing strong baselines across multiple datasets, particularly at higher task splits, while also offering faster training times.
CIRCLE achieves state-of-the-art performance in cold-start continual learning without ever fitting a backbone to image data, revolutionizing the approach to class-incremental learning.
Cold-start exemplar-free class-incremental learning requires learning a growing set of classes without replay, external pretraining, or a large initial task. Existing cold-start methods typically either train the backbone throughout the stream and compensate for semantic drift, or freeze a backbone after the first task, producing features biased toward the initial classes. These choices also create a computational tension: drift-compensation methods require repeated backbone training and increasingly expensive updates as the task horizon grows, while frozen-backbone methods are cheap but weak under cold start. We study a third option: a feature extractor that is never fit to image data at all. We propose CIRCLE, a class-incremental classifier built from fixed bidirectional two-dimensional reservoir features, adapted from BiRC2D for image classification, and streaming linear discriminant analysis heads. CIRCLE groups multiple random reservoir instantiations into feature ensembles and averages the softmax outputs of independent SLDA heads, yielding a tunable bias-variance tradeoff between richer random features and prediction-level ensembling. Because the feature extractor is fixed and the head admits streaming closed-form updates, CIRCLE performs sample-wise training without replay, task-boundary information, or backbone backpropagation. On CIFAR-100, TinyImageNet, ImageNet-Subset, and ImageNet-1k, CIRCLE is competitive at 10-20 task splits and substantially outperforms strong CS-EFCIL baselines at 50, 100, and 500 task splits, while training much faster than trained-backbone drift-compensation methods. Ablations show that the BiRC2D-style extractor, SLDA head, and balanced feature/prediction ensembling each contribute to the final performance.
