Puzzlingly High Correlations in fMRI Studies of Emotion, Personality, and Social Cognition - PubMed (original) (raw)
Puzzlingly High Correlations in fMRI Studies of Emotion, Personality, and Social Cognition
Edward Vul et al. Perspect Psychol Sci. 2009 May.
Free article
Abstract
Functional magnetic resonance imaging (fMRI) studiesofemotion, personality, and social cognition have drawn much attention in recent years, with high-profile studies frequently reporting extremely high (e.g., >.8) correlations between brain activation and personality measures. We show that these correlations are higher than should be expected given the (evidently limited) reliability of both fMRI and personality measures. The high correlations are all the more puzzling because method sections rarely contain much detail about how the correlations were obtained. We surveyed authors of 55 articles that reported findings of this kind to determine a few details on how these correlations were computed. More than half acknowledged using a strategy that computes separate correlations for individual voxels and reports means of only those voxels exceeding chosen thresholds. We show how this nonindependent analysis inflates correlations while yielding reassuring-looking scattergrams. This analysis technique was used to obtain the vast majority of the implausibly high correlations in our survey sample. In addition, we argue that, in some cases, other analysis problems likely created entirely spurious correlations. We outline how the data from these studies could be reanalyzed with unbiased methods to provide accurate estimates of the correlations in question and urge authors to perform such reanalyses. The underlying problems described here appear to be common in fMRI research of many kinds-not just in studies of emotion, personality, and social cognition.
© 2009 Association for Psychological Science.
Similar articles
- Discussion of "Puzzlingly High Correlations in fMRI Studies of Emotion, Personality, and Social Cognition" by Vul et al. (2009).
Lazar NA. Lazar NA. Perspect Psychol Sci. 2009 May;4(3):308-9. doi: 10.1111/j.1745-6924.2009.01129.x. Perspect Psychol Sci. 2009. PMID: 26158968 - Commentary on Vul et al.'s (2009) "Puzzlingly High Correlations in fMRI Studies of Emotion, Personality, and Social Cognition".
Nichols TE, Poline JB. Nichols TE, et al. Perspect Psychol Sci. 2009 May;4(3):291-3. doi: 10.1111/j.1745-6924.2009.01126.x. Perspect Psychol Sci. 2009. PMID: 26158965 - Reply to Comments on "Puzzlingly High Correlations in fMRI Studies of Emotion, Personality, and Social Cognition".
Vul E, Harris C, Winkielman P, Pashler H. Vul E, et al. Perspect Psychol Sci. 2009 May;4(3):319-24. doi: 10.1111/j.1745-6924.2009.01132.x. Perspect Psychol Sci. 2009. PMID: 26158970 No abstract available. - The person in political emotion.
Leach CW. Leach CW. J Pers. 2010 Dec;78(6):1827-59. doi: 10.1111/j.1467-6494.2010.00671.x. Epub 2010 Oct 12. J Pers. 2010. PMID: 21039533 Review. - [Alpha-interferon and mental disorders].
Debien C, De Chouly De Lenclave MB, Foutrein P, Bailly D. Debien C, et al. Encephale. 2001 Jul-Aug;27(4):308-17. Encephale. 2001. PMID: 11686052 Review. French.
Cited by
- Invalid Claims About the Validity of Implicit Association Tests by Prisoners of the Implicit Social-Cognition Paradigm.
Schimmack U. Schimmack U. Perspect Psychol Sci. 2021 Mar;16(2):435-442. doi: 10.1177/1745691621991860. Perspect Psychol Sci. 2021. PMID: 33709849 Free PMC article. - Neurofunctional correlates of ethical, food-related decision-making.
Cherry JB, Bruce JM, Lusk JL, Crespi JM, Lim SL, Bruce AS. Cherry JB, et al. PLoS One. 2015 Apr 1;10(4):e0120541. doi: 10.1371/journal.pone.0120541. eCollection 2015. PLoS One. 2015. PMID: 25830288 Free PMC article. - Striatal intrinsic reinforcement signals during recognition memory: relationship to response bias and dysregulation in schizophrenia.
Wolf DH, Gerraty R, Satterthwaite TD, Loughead J, Campellone T, Elliott MA, Turetsky BI, Gur RC, Gur RE. Wolf DH, et al. Front Behav Neurosci. 2011 Dec 16;5:81. doi: 10.3389/fnbeh.2011.00081. eCollection 2011. Front Behav Neurosci. 2011. PMID: 22355285 Free PMC article. - Number of events and reliability in fMRI.
Turner BO, Miller MB. Turner BO, et al. Cogn Affect Behav Neurosci. 2013 Sep;13(3):615-26. doi: 10.3758/s13415-013-0178-2. Cogn Affect Behav Neurosci. 2013. PMID: 23754543
LinkOut - more resources
Full Text Sources
Other Literature Sources