Search papers, labs, and topics across Lattice.
This paper introduces IDNet, a novel multimodal framework designed for ischemic heart disease (IHD) screening that effectively integrates high-dimensional retinal images with sparse clinical data through a Cross-Modal Distillation Aggregator (CDA). By constructing a comprehensive benchmark from the UK Biobank, consisting of 50,410 images from 25,205 subjects, the authors demonstrate that IDNet significantly outperforms existing image-only, clinical-only, and various multimodal approaches. The findings highlight the effectiveness of learnable queries in addressing the data imbalance and improving the robustness of IHD screening methodologies.
IDNet not only sets a new benchmark for IHD screening but also reveals that effective fusion of multimodal data can dramatically enhance diagnostic performance.
Color Fundus Photography (CFP) offers a low-cost and non-invasive route for ischemic heart disease (IHD) screening, but current studies are limited by scarce public benchmarks and ineffective fusion of retinal images with sparse clinical variables. We propose IDNet, a multimodal framework with a Cross-Modal Distillation Aggregator (CDA) that uses learnable queries to sequentially integrate left-eye, right-eye, and clinical features, mitigating the imbalance between high-dimensional visual features and low-dimensional tabular inputs. We also construct a reproducible UK Biobank benchmark with open-source curation and quality-control pipelines, yielding 50,410 images from 25,205 subjects. On this benchmark, IDNet outperforms image-only, clinical-only, and several multimodal baselines, and CDA consistently improves multiple visual encoders as a plug-in fusion module.
