Search papers, labs, and topics across Lattice.
This paper introduces Proportion Loss, borrowed from learning from label proportions (LLP), as a regularization term within semi-supervised learning (SSL) to address performance degradation under class imbalance. By aligning model predictions with the global class distribution, Proportion Loss mitigates bias amplification from pseudo-labeling in both majority and minority classes. Experiments on Long-tailed CIFAR-10 demonstrate that integrating Proportion Loss into FixMatch and ReMixMatch improves performance over baselines and achieves competitive results compared to existing class-imbalanced SSL methods, especially with scarce labels.
Class-imbalanced semi-supervised learning gets a boost from Proportion Loss, a simple regularization term that aligns model predictions with the global class distribution, outperforming existing methods on Long-tailed CIFAR-10.
Semi-supervised learning (SSL) often suffers under class imbalance, where pseudo-labeling amplifies majority bias and suppresses minority performance. We address this issue with a lightweight framework that, to our knowledge, is the first to introduce Proportion Loss from learning from label proportions (LLP) into SSL as a regularization term. Proportion Loss aligns model predictions with the global class distribution, mitigating bias across both majority and minority classes. To further stabilize training, we formulate a stochastic variant that accounts for fluctuations in mini-batch composition. Experiments on the Long-tailed CIFAR-10 benchmark show that integrating Proportion Loss into FixMatch and ReMixMatch consistently improves performance over the baselines across imbalance severities and label ratios, and achieves competitive or superior results compared to existing CISSL methods, particularly under scarce-label conditions.
