Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces MVGFDR, a novel Multi-View Graph Fusion framework for diabetic retinopathy (DR) grading that explicitly models inter-view correlations in multi-view fundus images. The framework uses a Multi-View Graph Fusion (MVGF) module comprised of multi-view graph initialization with DCT coefficients, multi-view graph fusion based on frequency-domain relevance, and masked cross-view reconstruction to learn view-invariant representations. Experiments on the MFIDDR dataset demonstrate that MVGFDR outperforms existing state-of-the-art methods for DR grading by effectively disentangling shared and view-specific features.
By explicitly disentangling shared and view-specific features across multi-view fundus images, MVGFDR achieves superior diabetic retinopathy grading compared to methods that directly fuse visual features.
Diabetic retinopathy (DR) is one of the leading causes of vision loss worldwide, making early and accurate DR grading critical for timely intervention. Recent clinical practices leverage multi-view fundus images for DR detection with a wide coverage of the field of view (FOV), motivating deep learning methods to explore the potential of multi-view learning for DR grading. However, existing methods often overlook the inter-view correlations when fusing multi-view fundus images, failing to fully exploit the inherent consistency across views originating from the same patient. In this work, we present MVGFDR, an end-to-end Multi-View Graph Fusion framework for DR grading. Different from existing methods that directly fuse visual features from multiple views, MVGFDR is equipped with a novel Multi-View Graph Fusion (MVGF) module to explicitly disentangle the shared and view-specific visual features. Specifically, MVGF comprises three key components: (1) Multi-view Graph Initialization, which constructs visual graphs via residual-guided connections and employs Discrete Cosine Transform (DCT) coefficients as frequency-domain anchors; (2) Multi-view Graph Fusion, which integrates selective nodes across multi-view graphs based on frequency-domain relevance to capture complementary view-specific information; and (3) Masked Cross-view Reconstruction, which leverages masked reconstruction of shared information across views to facilitate view-invariant representation learning. Extensive experimental results on MFIDDR, by far the largest multi-view fundus image dataset, demonstrate the superiority of our proposed approach over existing state-of-the-art approaches in diabetic retinopathy grading.
NVIDIA