Search papers, labs, and topics across Lattice.
This paper introduces BPG, a unified framework for domain incremental learning that enhances model adaptability while preserving prior knowledge. By employing BPG-Adapter to tailor the hidden dimensions of domain-specific adapters and BPG-Inference for soft domain mixture strategies during inference, the framework effectively balances plasticity and generalization. Experimental results show that BPG achieves state-of-the-art accuracy across multiple datasets, significantly reducing forgetting to just 0.22% on DomainNet.
BPG reduces forgetting to an impressive 0.22% while achieving state-of-the-art accuracy in domain incremental learning.
Deep neural networks excel in various tasks but struggle to generalize across evolving data distributions, leading to significant performance degradation under domain shifts. Domain incremental learning (DIL) addresses this challenge by enabling models to continuously adapt while retaining prior knowledge. Among existing DIL approaches, the parameter-isolation paradigm achieves state-of-the-art performance. However, these methods often adopt a one-size-fits-all approach to adapt to new domains, resulting in either insufficient learning capacity or redundant parameters. In this work, we propose BPG, a unified framework that addresses both challenges through two complementary components: BPG-Adapter, which dynamically determines each domain's adapter hidden dimension based on domain-specific feature separability, and BPG-Inference, a soft domain mixture strategy that integrates multiple domain-specific models at test time, mitigating domain ID misselection. Experimental results on DomainNet, CDDB, and CORe50 demonstrate that BPG consistently outperforms uniform adapter-based approaches and hard domain selection strategies, achieving state-of-the-art average accuracy while reducing forgetting to as low as 0.22% on DomainNet.
