Search papers, labs, and topics across Lattice.
The paper introduces SAFE, a two-stage framework for weakly supervised patch annotation in diabetic retinopathy (DR) screening, designed to address the limitations of sparse expert annotations. SAFE uses a dual-arm Patch Embedding Network and contrastive learning to generate class-discriminative embeddings from annotated patches, then extrapolates labels to unannotated regions based on spatial and semantic proximity using an ensemble of embedding spaces. Experiments show SAFE achieves high accuracy in separating healthy and diseased patches (up to 0.9886) and significantly improves downstream DR classification performance, with AUPRC gains as high as 0.545.
Stop hand-labeling lesion regions: this method uses contrastive learning and patch embeddings to automatically expand sparse annotations in diabetic retinopathy images, boosting downstream classification performance.
Diabetic Retinopathy (DR) requires timely screening to prevent irreversible vision loss. However, its early detection remains a significant challenge since often the subtle pathological manifestations (lesions) get overlooked due to insufficient annotation. Existing literature primarily focuses on image-level supervision, weakly-supervised localization, and clustering-based representation learning, which fail to systematically annotate unlabeled lesion region(s) for refining the dataset. Expert-driven lesion annotation is labor-intensive and often incomplete, limiting the performance of deep learning models. We introduce Similarity-based Annotation via Feature-space Ensemble (SAFE), a two-stage framework that unifies weak supervision, contrastive learning, and patch-wise embedding inference, to systematically expand sparse annotations in the pathology. SAFE preserves fine-grained details of the lesion(s) under partial clinical supervision. In the first stage, a dual-arm Patch Embedding Network learns semantically structured, class-discriminative embeddings from expert annotated patches. Next, an ensemble of independent embedding spaces extrapolates labels to the unannotated regions based on spatial and semantic proximity. An abstention mechanism ensures trade-off between highly reliable annotation and noisy coverage. Experimental results demonstrate reliable separation of healthy and diseased patches, achieving upto 0.9886 accuracy. The annotation generated from SAFE substantially improves downstream tasks such as DR classification, demonstrating a substantial increase in F1-score of the diseased class and a performance gain as high as 0.545 in Area Under the Precision-Recall Curve (AUPRC). Qualitative analysis, with explainability, confirms that SAFE focuses on clinically relevant lesion patterns; and is further validated by ophthalmologists.
