Search papers, labs, and topics across Lattice.
This paper introduces a novel architecture for analyzing retinal fundus images that employs sparse conditional computation to address the challenge of co-occurring pathologies. By integrating Guided Context Gating (GCG) with a Mixture-of-Experts (MoE) block, the model achieves a disease-dependent expert allocation, enhancing interpretability and performance in multi-disease screening. The proposed method demonstrates strong results on a five-class benchmark, achieving a macro AUC of 0.912 and a macro F1 of 0.653, while visualizations confirm the alignment of expert routing with specific lesions.
Expert allocation in retinal pathology detection is not only disease-dependent but also enhances interpretability, revealing how models can effectively disentangle complex co-occurring conditions.
Retinal fundus images frequently exhibit multiple co-occurring pathologies, yet standard deep learning classifiers apply static, identical computation to every image regardless of the underlying disease distribution. We propose a novel architecture that resolves this via sparse conditional computation, pairing a Guided Context Gating (GCG) spatial attention front-end with a sparsely-routed Mixture-of-Experts (MoE) block operating over feature tokens. Crucially, this routing yields an interpretable, data-driven decomposition. Expert allocation is significantly disease-dependent (p < 0.001), with the healthy Normal state and morphologically distinct pathologies (e.g., ERM, AMD) isolating to dedicated experts. On a five-class, patient-disjoint 5-fold cross-validation benchmark, our model achieves 0.912 +/- 0.008 macro AUC and 0.653 +/- 0.014 macro F1. Furthermore, Grad-CAM++ and post-MoE t-SNE visualizations confirm that expert routing aligns with localized lesions and geometrically maps co-occurring cases between their constituent clusters, positioning sparse MoE as an interpretable approach to multi-disease retinal screening.
