Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Locus, an anatomical attention regularization framework that utilizes pretrained segmentation foundation models to enhance medical image classification by guiding attention toward diagnostically relevant anatomical structures. By implementing a novel regularization term that balances attention between foreground anatomical regions and background noise, the framework mitigates the need for extensive manual annotation while improving model performance. Validation across eight diverse medical imaging datasets demonstrates that Locus not only boosts classification accuracy but also fosters anatomically grounded attention in predictions.
Leveraging segmentation foundation models, Locus achieves significant classification improvements while reducing reliance on labor-intensive anatomical annotations.
Medical image classification models are ideally expected to identify diagnostically relevant regions while making predictions, yet standard classification losses rarely provide spatial supervision. Explicit supervision via anatomical shape information, such as segmentation masks of task-relevant anatomy, has been shown to guide the network toward regions relevant to the target prediction. However, obtaining such masks incurs substantial manual annotation effort and computational overhead. With the advent of segmentation foundation models that exhibit strong localization of anatomical structures across diverse imaging modalities, we leverage this capability to extract anatomical shape priors without the burden of training a dedicated segmentation model. In this paper, we propose a new framework, Locus, an anatomical attention regularization framework that leverages pretrained segmentation foundation models to guide a classifier's attention toward diagnostically meaningful anatomical structures across diverse imaging modalities. Instead of enforcing pixel-wise alignment with the foundation-model-derived mask, we introduce a regularization term that adaptively balances attention between anatomical (foreground) and background regions, penalizing the classifier when background attention dominates. We validate Locus on eight diverse medical imaging datasets spanning dermoscopy, X-ray, histopathology, and cardiac MRI, showing consistent gains in classification performance alongside improved anatomically grounded attention.