Search papers, labs, and topics across Lattice.
This paper introduces Orthogonal Knowledge Refreshing (OKR), a novel framework for domain-incremental object detection (DIOD) that allows models to adapt to new domains while preserving prior knowledge. By constructing independent domain-specific subspaces and employing a gradient-based orthogonal refreshing strategy, OKR effectively minimizes knowledge interference and enhances performance across domains. Experimental results demonstrate that OKR significantly outperforms existing exemplar-free methods, achieving notable improvements in mean Average Precision (mAP) on benchmark datasets like Pascal VOC and BDD100K.
OKR achieves a remarkable +6.5% mAP improvement over existing methods by preventing knowledge interference in domain-incremental object detection.
Domain-incremental object detection (DIOD) requires models to continually adapt to new domains while preserving prior knowledge. Recently, parameter-efficient fine-tuning offers a promising avenue, wherein a pre-trained model is frozen and a small number of learnable parameters are injected for downstream tasks. However, these methods risk overwriting critical past knowledge, triggering inter-domain interference and performance degradation. To address this challenge, we propose Orthogonal Knowledge Refreshing (OKR), a simple yet effective framework for DIOD. OKR incrementally constructs independent domain-specific subspaces via dedicated low-rank branches for each domain, which are seamlessly fused for a holistic decision, enabling conflict-free capacity expansion without domain selection during inference. To minimize knowledge interference during fusion, we present a gradient-based orthogonal refreshing strategy that projects gradient updates of new domains onto the orthogonal complement of the fused historical subspace, supporting continual adaptation without forgetting. Moreover, to mitigate semantic fragmentation across domains, we enforce topology-aware consistency, aligning the semantic structures of old and new domains. Extensive experiments validate the superiority of OKR, outperforming the best exemplar-free method by significant margins of +5.6% and +6.5% mAP on the Pascal VOC and BDD100K series, respectively.
Tsinghua AI