Function-structure associations of the brain: evidence from multimodal connectivity and covariance studies - PubMed (original) (raw)
Review
Function-structure associations of the brain: evidence from multimodal connectivity and covariance studies
Jing Sui et al. Neuroimage. 2014.
Abstract
Despite significant advances in multimodal imaging techniques and analysis approaches, unimodal studies are still the predominant way to investigate brain changes or group differences, including structural magnetic resonance imaging (sMRI), functional MRI (fMRI), diffusion tensor imaging (DTI) and electroencephalography (EEG). Multimodal brain studies can be used to understand the complex interplay of anatomical, functional and physiological brain alterations or development, and to better comprehend the biological significance of multiple imaging measures. To examine the function-structure associations of the brain in a more comprehensive and integrated manner, we reviewed a number of multimodal studies that combined two or more functional (fMRI and/or EEG) and structural (sMRI and/or DTI) modalities. In this review paper, we specifically focused on multimodal neuroimaging studies on cognition, aging, disease and behavior. We also compared multiple analysis approaches, including univariate and multivariate methods. The possible strengths and limitations of each method are highlighted, which can guide readers when selecting a method based on a given research question. In particular, we believe that multimodal fusion approaches will shed further light on the neuronal mechanisms underlying the major structural and functional pathophysiological features of both the healthy brain (e.g. development) or the diseased brain (e.g. mental illness) and, in the latter case, may provide a more sensitive measure than unimodal imaging for disease classification, e.g. multimodal biomarkers, which potentially can be used to support clinical diagnosis based on neuroimaging techniques.
Keywords: Brain connectivity; Diffusion MRI; EEG; Multimodal fusion; fMRI; sMRI.
© 2013.
Figures
Figure 1. Functional and anatomical connectivity that differs between healthy controls and schizophrenia
(a) Connections between brain regions that was lower in schizophrenia patients than controls (p<0.01) in measure of anatomical connectivity (DTI) (b)Connections between brain regions that differ between SZ and HC in functional connectivity (FMRI). Red lines represent connections for which the functional connectivity was higher in patients, whereas for green line, connectivity was higher in control subjects (p<0.02). IFG, inferior frontal gyrus; IPL, inferior parietal lobule; MTG, middle temporal gyrus; STG, superior temporal gyrus. Ant., anterior;
Figure 2. An example of functional-structural connectivity study by (Segall et al., 2012)
The structural (sMRI) components (red) and corresponding rs-fMRI components (blue). The spatial correlation between component pairs is indicated adjacent to the functional component number. Both sMRI and fMRI aggregate components were converted to z-scores and thresholded at Z > 2. Structural components are displayed at the slices with peak activation, indicated as (x, y, z) coordinates in MNI space. Functional components are displayed at different coordinates that best represent their activation.
Figure 3. fMRI-sMRI-DTI fusion by mCCA+jICA
Summary of joint and modal specific group discriminative ICs(p<0.05). Joint ICs is significantly group-discriminative in more than 2 modalities, such as IC1, IC2 and IC9. In addition, fMRI_IC4, DTI_IC3 and DTI_IC7 only show significance in a single modality, they are called modal-specific discriminative ICs(pink framed). Hence the modal MCCA+jICA enable people to capture components of interest that are either common or distinct across modalities.
Figure 4. Frequency of published multimodal fusion studies using brain imaging data
Similar articles
- Integrated Brain Connectivity Analysis with fMRI, DTI, and sMRI Powered by Interpretable Graph Neural Networks.
Qu G, Zhou Z, Calhoun VD, Zhang A, Wang YP. Qu G, et al. ArXiv [Preprint]. 2024 Aug 26:arXiv:2408.14254v1. ArXiv. 2024. PMID: 39253637 Free PMC article. Preprint. - Fusing DTI and fMRI data: a survey of methods and applications.
Zhu D, Zhang T, Jiang X, Hu X, Chen H, Yang N, Lv J, Han J, Guo L, Liu T. Zhu D, et al. Neuroimage. 2014 Nov 15;102 Pt 1:184-91. doi: 10.1016/j.neuroimage.2013.09.071. Epub 2013 Oct 5. Neuroimage. 2014. PMID: 24103849 Free PMC article. Review. - Complementary contributions of concurrent EEG and fMRI connectivity for predicting structural connectivity.
Wirsich J, Ridley B, Besson P, Jirsa V, Bénar C, Ranjeva JP, Guye M. Wirsich J, et al. Neuroimage. 2017 Nov 1;161:251-260. doi: 10.1016/j.neuroimage.2017.08.055. Epub 2017 Aug 24. Neuroimage. 2017. PMID: 28842386 - Multimodal magnetic resonance neuroimaging measures characteristic of early cART-treated pediatric HIV: A feature selection approach.
Khobo IL, Jankiewicz M, Holmes MJ, Little F, Cotton MF, Laughton B, van der Kouwe AJW, Moreau A, Nwosu E, Meintjes EM, Robertson FC. Khobo IL, et al. Hum Brain Mapp. 2022 Sep;43(13):4128-4144. doi: 10.1002/hbm.25907. Epub 2022 May 16. Hum Brain Mapp. 2022. PMID: 35575438 Free PMC article. - EEG-fMRI integration for the study of human brain function.
Jorge J, van der Zwaag W, Figueiredo P. Jorge J, et al. Neuroimage. 2014 Nov 15;102 Pt 1:24-34. doi: 10.1016/j.neuroimage.2013.05.114. Epub 2013 May 31. Neuroimage. 2014. PMID: 23732883 Review.
Cited by
- A within-subject voxel-wise constant-block partial least squares correlation method to explore MRI-based brain structure-function relationship.
Zhao X, Chen K, Wang H, Gao Y, Ji X, Li Y. Zhao X, et al. Cogn Neurodyn. 2024 Jun;18(3):813-827. doi: 10.1007/s11571-023-09941-3. Epub 2023 Feb 18. Cogn Neurodyn. 2024. PMID: 39539980 - Integrated Brain Connectivity Analysis with fMRI, DTI, and sMRI Powered by Interpretable Graph Neural Networks.
Qu G, Zhou Z, Calhoun VD, Zhang A, Wang YP. Qu G, et al. ArXiv [Preprint]. 2024 Aug 26:arXiv:2408.14254v1. ArXiv. 2024. PMID: 39253637 Free PMC article. Preprint. - A spatially constrained independent component analysis jointly informed by structural and functional network connectivity.
Fouladivanda M, Iraji A, Wu L, van Erp TGM, Belger A, Hawamdeh F, Pearlson GD, Calhoun VD. Fouladivanda M, et al. bioRxiv [Preprint]. 2024 Jun 1:2023.08.13.553101. doi: 10.1101/2023.08.13.553101. bioRxiv. 2024. PMID: 38853973 Free PMC article. Preprint. - Analysis of Longitudinal Change Patterns in Developing Brain Using Functional and Structural Magnetic Resonance Imaging via Multimodal Fusion.
Saha R, Saha DK, Fu Z, Duda M, Silva RF, Calhoun VD. Saha R, et al. bioRxiv [Preprint]. 2024 Apr 10:2024.04.07.588473. doi: 10.1101/2024.04.07.588473. bioRxiv. 2024. PMID: 38645216 Free PMC article. Preprint. - Disrupted small-world white matter networks in patients with major depression and recent suicide plans or attempts.
Li H, Zhang H, Qin K, Yin L, Chen Z, Zhang F, Wu B, Chen T, Sweeney JA, Gong Q, Jia Z. Li H, et al. Brain Imaging Behav. 2024 Aug;18(4):741-752. doi: 10.1007/s11682-024-00870-1. Epub 2024 Feb 26. Brain Imaging Behav. 2024. PMID: 38407738
References
- Allen EA, Erhardt EB, Damaraju E, Gruner W, Segall JM, Silva RF, Havlicek M, Rachakonda S, Fries J, Kalyanam R, Michael AM, Caprihan A, Turner JA, Eichele T, Adelsheim S, Bryan AD, Bustillo J, Clark VP, Feldstein Ewing SW, Filbey F, Ford CC, Hutchison K, Jung RE, Kiehl KA, Kodituwakku P, Komesu YM, Mayer AR, Pearlson GD, Phillips JP, Sadek JR, Stevens M, Teuscher U, Thoma RJ, Calhoun VD. A baseline for the multivariate comparison of resting-state networks. Front Syst Neurosci. 2011;5:2. - PMC - PubMed
- Ardnt C. SPIE Proc. 1996. Information gained by data fusion.
- Ashburner J, Friston KJ. Voxel-based morphometry--the methods. Neuroimage. 2000;11:805–821. - PubMed
- Behrens T, Johansen-Berg H. Diffusion MRI:from quantitative measurement to in-vivo neuroanatomy. Elsevier; 2009.
Publication types
MeSH terms
Grants and funding
- P20 GM103472/GM/NIGMS NIH HHS/United States
- R01 EB005846/EB/NIBIB NIH HHS/United States
- R01EB005846/EB/NIBIB NIH HHS/United States
- R01 EB006841/EB/NIBIB NIH HHS/United States
- R01EB 006841/EB/NIBIB NIH HHS/United States
- R01 EB020407/EB/NIBIB NIH HHS/United States
LinkOut - more resources
Full Text Sources
Other Literature Sources
Medical