Search papers, labs, and topics across Lattice.
This paper introduces BrainWorld, a generative model that leverages structural MRI (sMRI) to conditionally generate whole-brain 4D fMRI dynamics, addressing the limitations of existing models that focus primarily on representation learning. By integrating anatomical context into the denoising process, BrainWorld achieves stable 4D fMRI trajectory generation across 22 diverse datasets, demonstrating significant improvements in downstream task performance through example augmentation. The model not only enhances the fidelity of brain dynamics modeling but also learns transferable multimodal representations that surpass current baselines.
BrainWorld generates stable 4D fMRI trajectories by integrating structural MRI, outperforming existing models in both fidelity and multimodal representation learning.
Whole-brain 4D fMRI generation is valuable for modeling functional brain dynamics, yet existing fMRI foundation models mainly target representation learning and downstream prediction rather than conditional predictive generation. We introduce BrainWorld, a structural-prior-conditioned generative model for whole-brain 4D fMRI dynamics. BrainWorld uses sMRI as subject-level anatomical context to guide future fMRI generation, integrating structural information into the denoising process rather than treating it as a parallel modality. Evaluated on 22 datasets spanning diverse cohorts and brain states, BrainWorld generates stable 4D fMRI trajectories up to 400 frames, improves downstream performance through generated-example augmentation, and learns transferable multimodal representations that outperform baselines. Together, these results establish BrainWorld as a condition-aware generative framework for long-horizon brain dynamics modeling and multimodal representation learning.
