Search papers, labs, and topics across Lattice.
This paper addresses the problem of long-tailed class distributions in semi-supervised domain generalization (SSDG). They propose IMaX, an InfoMax-based objective that maximizes the mutual information between learned features and latent labels, while being constrained by labeled data. IMaX incorporates an α-entropic objective to mitigate class-balance bias, improving performance on long-tailed distributions and enhancing existing SSDG methods.
State-of-the-art semi-supervised domain generalization (SSDG) methods crumble when faced with the real-world challenge of long-tailed class distributions, but IMaX offers a simple, effective fix.
Semi-supervised domain generalization (SSDG) has recently emerged as an appealing alternative to tackle domain generalization when labeled data is scarce but unlabeled samples across domains are abundant. In this work, we identify an important limitation that hampers the deployment of state-of-the-art methods on more challenging but practical scenarios. In particular, state-of-the-art SSDG severely suffers in the presence of long-tailed class distributions, an arguably common situation in real-world settings. To alleviate this limitation, we propose IMaX, a simple yet effective objective based on the well-known InfoMax principle adapted to the SSDG scenario, where the Mutual Information (MI) between the learned features and latent labels is maximized, constrained by the supervision from the labeled samples. Our formulation integrates an α-entropic objective, which mitigates the class-balance bias encoded in the standard marginal entropy term of the MI, thereby better handling arbitrary class distributions. IMaX can be seamlessly plugged into recent state-of-the-art SSDG, consistently enhancing their performance, as demonstrated empirically across two different image modalities.
