Search papers, labs, and topics across Lattice.
This paper introduces ProCal, a novel probability calibration method for Source-Free Domain Adaptation (SFDA) that addresses the over-reliance on prediction similarity among neighbors. ProCal uses a dual-model collaborative prediction mechanism, integrating the source model's initial predictions with the current model's online outputs to dynamically calibrate neighborhood-based predictions. Experiments across 31 cross-domain tasks demonstrate that ProCal effectively balances knowledge retention and domain adaptation, mitigating local noise and knowledge forgetting.
Over-reliance on neighborhood similarity in source-free domain adaptation hurts performance; ProCal offers a way to dynamically calibrate predictions and improve generalization.
Source-Free Domain Adaptation (SFDA) adapts pre-trained models to unlabeled target domains without requiring access to source data. Although state-of-the-art methods leveraging local neighborhood structures show promise for SFDA, they tend to over-rely on prediction similarity among neighbors. This over-reliance accelerates the forgetting of source knowledge and increases susceptibility to local noise overfitting. To address these issues, we introduce ProCal, a probability calibration method that dynamically calibrates neighborhood-based predictions through a dual-model collaborative prediction mechanism. ProCal integrates the source model's initial predictions with the current model's online outputs to effectively calibrate neighbor probabilities. This strategy not only mitigates the interference of local noise but also preserves the discriminative information from the source model, thereby achieving a balance between knowledge retention and domain adaptation. Furthermore, we design a joint optimization objective that combines a soft supervision loss with a diversity loss to guide the target model. Our theoretical analysis shows that ProCal converges to an equilibrium where source knowledge and target information are effectively fused, reducing both knowledge forgetting and overfitting. We validate the effectiveness of our approach through extensive experiments on 31 cross-domain tasks across four public datasets. Our code is available at: https://github.com/zhengyinghit/ProCal.
