Search papers, labs, and topics across Lattice.
This paper introduces FlexiGrad, an adaptive gradient modulation technique designed to resolve hierarchical gradient conflicts in fine-grained classification tasks. By selectively regulating gradient interactions during backpropagation, FlexiGrad stabilizes training and enhances the model's ability to learn coherent representations across multiple classification levels. The method demonstrates significant improvements in multi-granularity accuracy on benchmark datasets such as CUB-200-2011, FGVC-Aircraft, and Stanford Cars, without requiring modifications to existing architectures.
FlexiGrad eliminates harmful gradient conflicts, leading to more stable training and improved accuracy in hierarchical fine-grained classification tasks.
Many fine-grained recognition tasks contain hierarchical labels such as order, family and species. Although this supervision should be beneficial, jointly optimising all levels often leads to unstable training because coarse and fine classifiers impose inconsistent gradients on the shared backbone. This hierarchical gradient conflict prevents the model from learning a coherent coarse-to-fine representation. In this paper, we propose FlexiGrad, a simple and parameter-free method that regulates gradient interactions during backpropagation. FlexiGrad removes only the harmful conflicting component when tasks disagree and reinforces the shared direction when they partially agree through a smooth hierarchy-aware weighting function. This produces stable optimisation and preserves both global structure and fine-grained discriminative cues. FlexiGrad integrates into existing architectures without modification while improves multi-granularity accuracy on CUB-200-2011, FGVC-Aircraft and Stanford Cars. The code will be available at PRIS-CV/FlexiGrad.
