Search papers, labs, and topics across Lattice.
This paper introduces KBK (Knowing Beyond the Known), a reinforced knowledge specification framework designed to enhance multi-label class-incremental learning (MLCIL) by addressing the challenges of ambiguous knowledge boundaries. The framework employs a hierarchical feature purification module to disentangle class-specific features from global features, while an uncertainty-aware recall enhancement strategy improves historical knowledge retention. Experimental results demonstrate that KBK outperforms existing methods by 2.7% in average accuracy on the MS-COCO B0-C10 benchmark without relying on replay buffers, highlighting its effectiveness in managing co-occurring and incomplete labels.
KBK achieves a 2.7% accuracy boost over previous methods in multi-label class-incremental learning, all without using replay buffers.
Existing class-incremental learning methods struggle in multi-label scenarios (MLCIL) due to the inherent contradiction of learning objectives arising from co-occurring and incomplete labels. We argue that the core obstacle is the model's ambiguous boundary between known and unknown knowledge, which undermines historical knowledge retention, complicates current task learning, and limits adaptability to future concepts. To address this, we propose KBK (Knowing Beyond the Known), a reinforced knowledge specification framework that explicitly models what is known or not to unify historical, current, and prospective learning. Specifically, to clarify known knowledge, we develop a hierarchical feature purification module that disentangles fine-grained class-specific features from global features, where high-level semantic abstraction is reinforced with low-level visual features. Additionally, an uncertainty-aware recall enhancement strategy suppresses unreliable predictions based on distribution priors, improving the quality of historical recall. For probing the unknown, KBK leverages semantic correlations to synthesize informative unknown features under co-occurring, preserving embedding space for future learning. Furthermore, to mitigate heterogeneous forgetting, we design a category-balanced gradient compensation loss that dynamically reweights gradient backpropagation according to forgetting speeds. Experiments on multiple benchmarks validate the effectiveness and robustness of KBK, which surpasses prior best methods by 2.7% in Avg. Acc on MS-COCO B0-C10 setting even without any replay buffers.
