Search papers, labs, and topics across Lattice.
This paper addresses the challenges of long-tailed recognition in deep learning by introducing Self-Adaptive Monotonic Normalization (SAMN), which eliminates the need for hyperparameter tuning associated with traditional adaptive norm rescaling methods. By employing the Pool Adjacent Violators Algorithm, SAMN enforces monotonicity on per-class weight norms, leading to improved performance without the pitfalls of hyperparameter sensitivity. Experimental results on benchmark datasets show that SAMN significantly enhances long-tailed recognition capabilities, often achieving state-of-the-art performance.
SAMN achieves state-of-the-art long-tailed recognition performance without the burden of hyperparameter tuning.
Long-tailed recognition poses a significant challenge for deep learning. The two-stage decoupling paradigm, which separates representation learning from classifier retraining, offers a promising solution. During the classifier retraining stage, adaptive norm rescaling is a popular technique. It adjusts the per-class weight norms via parameter regularization, which inevitably introduces hyperparameters. However, many studies report that long-tailed recognition is sensitive to these hyperparameters, as their setup significantly impacts performance. In this paper, we first provide a class-conditional distribution perspective to support norm rescaling methods. Furthermore, we propose a simple but effective approach called Self-Adaptive Monotonic Normalization (SAMN). SAMN avoids the need for parameter regularization. It directly enforces monotonicity on per-class weight norms using the Pool Adjacent Violators Algorithm, making the method hyperparameter-friendly. SAMN is a universal strategy that integrates seamlessly with other methods for enhanced performance. Experiments on benchmark datasets demonstrate that our method significantly boosts long-tailed recognition performance, often achieving state-of-the-art results.
