Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study benchmarks the external generalization of SPD matrix learning methods for predicting age from resting-state fMRI connectomes across six diverse datasets. The authors find that while methods perform well within datasets, performance significantly declines when tested on entirely held-out datasets, revealing that age-range mismatch and cohort heterogeneity critically impact prediction accuracy. By providing a standardized evaluation framework, this work aims to enhance the reproducibility and comparability of future research in fMRI connectome analysis.
External validation reveals that age prediction from fMRI connectomes falters significantly when tested across diverse cohorts, challenging the reliability of current models.
Resting-state functional magnetic resonance imaging (rs-fMRI) functional connectivity (FC) matrices are widely used for individual-level prediction, but strong performance within one cohort may not generalize to a new cohort. We ask whether within-dataset performance remains when the test data come from an entirely held-out rs-fMRI dataset. Each scan is represented as a regularized symmetric positive definite (SPD) correlation connectome, which allows methods to use the geometry of the SPD manifold. We introduce a reproducible age-prediction benchmark across six rs-fMRI datasets: COBRE, ADNIDOD, Cam-CAN, ABIDE, OASIS-3, and ADNI. The benchmark compares a vectorized correlation baseline, Tangent-Space Ridge, SPDNet, and split-wise Riemannian harmonization under within-dataset GroupKFold, pooled GroupKFold, and leave-one-dataset-out (LODO) evaluation. Within-dataset and pooled GroupKFold results are substantially more favorable than LODO results. When an entire dataset is held out, prediction error increases, differences among methods narrow, and performance is strongly affected by age-range mismatch and cohort heterogeneity. The benchmark provides common inputs, model settings, data splits, and analysis scripts so that future SPD matrix learning methods can be evaluated under the same external-validation protocol.