Search papers, labs, and topics across Lattice.
This paper investigates the failure mode of model collapse in entropy minimization (EM) during test-time adaptation, revealing that distribution shifts can merge feature clusters of distinct classes, leading to prediction bias. The authors introduce Distribution Shift Bias Reduction (DSBR), a novel objective that mitigates this bias by equalizing the contribution of each predicted class to the unsupervised entropy loss. Experimental results across multiple medical imaging datasets and ImageNet-C demonstrate that DSBR stabilizes test-time adaptation and outperforms existing methods without requiring additional training data.
Prediction bias in medical imaging models can be effectively mitigated with a new objective that prevents model collapse during test-time adaptation.
Entropy minimization (EM) is the dominant objective for test-time adaptation, yet its failure mode, model collapse, remains poorly understood. In this work, we show that distribution shifts can cause feature clusters corresponding to distinct classes in the model's representation space to merge, while the decision boundary remains fixed. This induces a systematic skew in the predicted class distribution, referred to as prediction bias. Prediction bias refers to a shift in the predicted class distribution, with some classes overrepresented and others suppressed. We show that entropy minimization amplifies this prediction bias by tightening the existing clusters, reinforcing the incorrect groupings until all predictions collapse to a trivial solution. Next, to demonstrate the significance of prediction bias and mitigate it, we further propose Distribution Shift Bias Reduction (DSBR), a bias-correcting objective that specifically targets this failure mode by equalizing the contribution of each predicted class to the unsupervised entropy minimization loss. To study this failure mode, we design suitable adaptation settings using four medical-imaging datasets and additionally evaluate on ImageNet-C. We find that DSBR consistently stabilizes test-time adaptation, prevents model collapse, and matches or outperforms state-of-the-art methods. Moreover, DSBR operates solely at test-time.
