Search papers, labs, and topics across Lattice.
The paper introduces Multi-scale Adaptive Graph Network (MAGNet), a novel Transformer-style graph neural network that adaptively learns structure-function interactions in the brain by fusing structural MRI-derived morphological features with functional connectivity from resting-state fMRI. MAGNet employs a hybrid graph integrating direct and indirect pathways, along with local-global attention, and a joint loss function to enforce cross-modal coherence. Experiments on the ABCD dataset demonstrate that MAGNet outperforms existing baselines in predicting cognitive function, showcasing the effectiveness of multimodal integration.
Brain-inspired AI gets a boost: a new graph neural network fuses structural and functional brain data to predict cognitive function better than ever before.
Understanding how brain structure and function interact is key to explaining intelligence yet modeling them jointly is challenging as the structural and functional connectome capture complementary aspects of organization. We introduced Multi-scale Adaptive Graph Network (MAGNet), a Transformer-style graph neural network framework that adaptively learns structure-function interactions. MAGNet leverages source-based morphometry from structural MRI to extract inter-regional morphological features and fuses them with functional network connectivity from resting-state fMRI. A hybrid graph integrates direct and indirect pathways, while local-global attention refines connectivity importance and a joint loss simultaneously enforces cross-modal coherence and optimizes the prediction objective end-to-end. On the ABCD dataset, MAGNet outperformed relevant baselines, demonstrating effective multimodal integration for advancing our understanding of cognitive function.
