Search papers, labs, and topics across Lattice.
This study introduces a novel framework for synthesizing fluorescein angiography (FFA) from non-invasive color fundus photography (CFP) by leveraging structural guidance from optical coherence tomography (OCT). By constructing the first tri-modally aligned dataset of 3,676 patient eyes and employing a Spatially Aligned Cross-Modal Fusion (SACMF) module alongside a Token-wise Cross-Modality Alignment (TCMA) strategy, the researchers enhance the synthesis of FFA images with improved accuracy and clinical relevance. The results indicate that the synthesized FFA images significantly enhance downstream disease diagnosis performance, demonstrating the framework's potential as a non-invasive decision-support tool in clinical settings.
Synthesizing FFA from non-invasive CFP using OCT guidance not only improves image quality but also boosts diagnostic accuracy for retinal diseases.
Fundus fluorescein angiography (FFA) is critical for assessing retinal vascular abnormalities, but its acquisition is invasive and not always feasible. In contrast, color fundus photography (CFP) is non-invasive and widely accessible, which has motivated studies on CFP-to-FFA synthesis. However, prior works rely solely on CFP surface texture, fundamentally limiting the ability to reconstruct functional vascular information and subtle pathological changes. To address this, we propose a novel framework that synthesizes FFA from CFP with structural guidance provided by optical coherence tomography (OCT). We construct a multi-modal retinal imaging dataset with paired CFP, FFA, and OCT from 3,676 patient eyes--the first tri-modally aligned dataset in retinal imaging. To bridge the spatial gap between OCT and fundus modalities, we propose a Spatially Aligned Cross-Modal Fusion (SACMF) module that projects depth-resolved OCT features onto the fundus plane and injects them into the CFP encoder via adaptive layer normalization. Beyond feature fusion, we further introduce Token-wise Cross-Modality Alignment (TCMA), a token-level contrastive learning strategy that explicitly aligns CFP and FFA representations at corresponding spatial positions. Our method achieves superior synthesis performance compared to state-of-the-art methods. Moreover, extensive experiments demonstrate that the FFA images synthesized by our approach bring greater improvements in downstream disease diagnosis performance than existing methods, highlighting the clinical potential of our approach as a non-invasive decision-support tool in routine workflows. The code is available at https://github.com/while-plus/OCT-guide-FFA-Syn.
