Neural organization of spoken language revealed by lesion–symptom mapping (original) (raw)

Introduction

From the earliest days of cognitive neuroscience, detailed studies of patients with acquired cognitive deficits following brain damage have provided the strongest evidence regarding the neural basis of cognition. This is because focal brain injury can cause a specific and lasting impairment to a cognitive process only if the damaged region made an indispensable contribution to that process. Contemporary neuroimaging techniques permit investigators to study the neural basis of cognition and language with greater anatomical precision. The present study draws on the strengths of these distinct methods by combining broad and deep behavioural assessment, high-quality structural neuroimaging and contemporary neuroimaging analysis techniques, to examine the functional and neural organization of language processing in patients with acquired language deficits.

The traditional neurological model of language and the brain1,2 postulates a division between production and comprehension processes within the left peri-Sylvian cortex: lesions in posterior superior temporal regions (‘Wernicke’s area’) disrupt auditory language comprehension, lesions in inferior frontal regions (‘Broca’s area’) disrupt speech production and white matter lesions that disconnect these areas impair repetition of heard speech. Contemporary theories of language and the brain bear the important imprint of functional neuroimaging and they depart from the traditional view in important respects3. One proposal is that there are ‘primary’ brain systems for semantics, phonology and syntax, each contributing to both the comprehension and production of language4,5. Other ‘dual pathways’ models propose that language is subserved by two distinct pathways, differentially specialized for the recognition and production of speech6,7,8. Most contemporary models recognize the contribution of regions outside the classical peri-Sylvian language areas, particularly in relation to the processing of word and sentence meaning9,10,11,12. Finally, the advent of diffusion tensor imaging has led to an explosive growth in research on the fibre tracts of the brain and a re-evaluation of classical ‘disconnection’ accounts of aphasic and other syndromes13,14.

The present study integrates several distinct threads of traditional and contemporary views by bringing together experimental psychology, cognitive neurology and neuroimaging methods. This study focuses on word-level language processing, because words are the primary building blocks of language—they form the critical junction point between the perceptual demands of speech recognition, the cognitive demands of processing meaning and the motor demands of speech production. Similar to the nineteenth century studies that produced the classical Broca–Wernicke–Lichtheim model, this study examined individuals with neurogenic language disorders, but on an unprecedented scale: 99 individuals with chronic language deficits (aphasia) following left hemisphere stroke were assessed on 17 different measures covering a wide range of language functions, including speech perception, spoken word production, verbal and non-verbal semantic cognition and short-term memory15. Factor analysis with varimax rotation was used to identify the key dimensions of variability in performance. This provided a data-driven model of the functional organization of language processing. Advances in neuroimaging analysis were then leveraged to carry out voxel-based lesion–symptom mapping (VLSM16) and identify the brain regions where lesions produced deficits of these functional systems. See Methods section for a more detailed description of the participants, language tests and measures, and factor analysis and lesion analysis methods. The result is a novel synthesis that reveals two major divisions within the language system—meaning versus form and recognition versus production—and how they are instantiated in the brain.

Results

Factor analysis

We used factor analysis with varimax rotation to identify key dimensions of variability on 17 measures of language function in 99 individuals with chronic language deficits following left hemisphere stroke. Three factors had eigenvalues above 1.0, passing the Kaiser threshold for inclusion in exploratory factor analysis. The first factor had high loadings from tests that require recognition of semantic relationships or matches, including verbal comprehension (word-to-picture matching and synonym judgments) and non-verbal comprehension (picture association judgments). These tests all require extracting task-appropriate semantic content from pictures or words but do not require substantial additional processing, as might be necessary for categorical inference or semantically driven word production; hence, we call this factor ‘Semantic Recognition’. The second factor had high positive loadings from tests of word and nonword repetition and negative loading from production of phonological errors in picture naming. These tests capture phonological/articulatory encoding for speech production; hence, we call this factor ‘Speech Production’. The third factor had high loadings from auditory lexical decision and phoneme discrimination tests, and moderate loadings from rhyme discrimination and word and nonword repetition tests. These tests capture auditory-phonological perception; hence, we call this factor ‘Speech Recognition’. The fourth factor had eigenvalue just below 1.0 (0.947), but had only one high loading: semantic errors in picture naming. Semantic error production was only moderately correlated with deficits on measures of semantic recognition (all Kendall rank correlations: τ<0.25) and, in a three-factor solution, this behavioural score did not load strongly on any of the factors (all loadings <0.4), suggesting that it is relatively independent of the other factors. Semantic errors in naming were previously analysed in a subset of the present group17,18 and they provide a potentially important comparison for the first factor; thus, this factor was also retained (we will refer to it as ‘Semantic Errors’). The resulting four-factor solution captured 76% of the variance in the original data and the loadings are shown in Fig. 1.

Figure 1: Factor analysis results.

Each panel shows the factor loadings of each test on the named factor. Longer and more saturated bars correspond to stronger loadings, with blue indicating positive loading and red indicating negative loading. See Methods for detailed descriptions of the tests and performance measures.

The factor scores tended to be negatively correlated with lesion volume: larger lesions were associated with poorer performance on the Semantic Recognition factor (Kendall rank correlation: _τ_=−0.23, P<0.001), the Speech Production factor (_τ_=−0.19, _P_<0.01) and the Semantic Errors factor (_τ_=−0.18, _P_<0.01), although not on the Speech Recognition factor (_τ_=−0.06, _P_>0.3). Therefore, the VLSM analyses included a control for lesion size that amounted to weighting lesioned voxels from small lesions more heavily than those from larger lesions (see Methods for details).

The data-driven factor analysis approach revealed two major divisions in the cognitive architecture of language processing. The first was between semantic and phonological processing: in this large group of individuals with aphasia from left hemisphere stroke, the severity of deficits related to semantic processing varied independently from severity of deficits related to phonological processing. Both the semantic and phonological processing deficits could be further subdivided roughly between recognition and production: severity of semantic or phonological deficits in word production varied independently from severity of deficits in semantic or phonological recognition. We next investigated the neural organization of this cognitive architecture by examining which lesion locations were associated with variation along these cognitive dimensions.

Voxel-based lesion–symptom mapping

VLSM of the Semantic Errors factor (Fig. 2) reproduced (with a larger sample of participants and transformed behavioural measure) our group’s previous findings that focal lesions of the left anterior temporal lobe (ATL) are associated with increased semantic errors in picture naming17,18 (and a similar pattern is observed in progressive aphasia due to neurodegenerative disease19,20). The behavioural dissociation of the Semantic Errors factor from the Semantic Recognition factor further indicates that the left ATL is specifically involved in semantically driven spoken word production. This result also shows that there was sufficient statistical power to detect lesion–symptom associations in the left ATL. Theories that emphasize the role of the ATL in modality-independent semantic processing10,19,20,21,22,23 would predict this as the most probable location where lesions would cause deficits in Semantic Recognition.

Figure 2: VLSM of Semantic Errors.

VLSM _t_-map supra-threshold (FDR _q_=0.05, t<−2.66) voxels for Semantic Errors factor scores with direct total lesion volume control.

VLSM of the Semantic Recognition factor identified no voxels in the ATL, even at a relaxed _q_=0.1 False Discovery Rate (FDR) threshold (Fig. 3), nor were there voxels in any other cortical region typically associated with semantic processing, such as the middle temporal gyrus or the angular gyrus9,24. Instead, the identified voxels were primarily in the white matter medial to the insula and lateral to the basal ganglia. Several white matter tracts converge in this region, including the inferior fronto-occipital fasciculus, the uncinate fasciculus and the anterior thalamic radiations. The region did not include the superior longitudinal fasciculus (SLF III, which on some accounts corresponds to the fronto-parietal portion of the arcuate fasciculus25): the SLF/AF passes dorsally to this region26 or, on some accounts27, terminates posterior to it. The convergence of major white matter tracts in the identified area creates a ‘bottleneck’ where a small amount of damage can cause a large degree of dysfunction in connections between frontal cortices and the rest of the brain. The association with the semantic recognition factor probably owes to the fact that semantic cognition requires integration across multiple regions of a distributed cortical network9,21. Our proposal is that damage to the bottleneck region disrupts connectivity between the frontal lobe and other brain regions involved in semantic processing, consistent with other recent findings28,29,30.

Figure 3: VLSM of Semantic Recognition.

VLSM of Semantic Recognition factor scores with direct total lesion volume control. Voxels exceeding FDR threshold _q_=0.1 are shown in red, superimposed on outlines of key white matter tracts: uncinate fasciculus (light blue), inferior fronto-occipital fasciculus (green) and anterior thalamic radiations (blue). Bottom panel shows a tractography reconstruction of these tracts and the supra-threshold voxels using the same colour scheme. See Methods for details of white matter rendering.

VLSM of the Speech Production factor identified a region superior to the Sylvian fissure, primarily in the supramarginal gyrus and extending anteriorly into inferior postcentral, precentral and premotor cortex (Fig. 4, blue–green). These regions form part of the dorsal language pathway of dual-pathway models and have been shown in other reports to be involved in speech production6,31,32. VLSM of the Speech Recognition factor identified a parallel region inferior to the Sylvian fissure, primarily in the superior temporal gyrus, including prominent involvement in Wernicke’s area and extending deep into planum temporale (Fig. 4, red–yellow). Together, these two factors map the classic peri-Sylvian language regions and the superior-inferior division between production and recognition provides new evidence to refine the dorsal–ventral division in dual-pathway models of speech processing6,8.

Figure 4: VLSM of Speech Recognition and Production.

VLSM _t_-map showing supra-threshold (FDR _q_=0.05) voxels for the Speech Production factor (blue–green) and the Speech Recognition factor (red–yellow) with direct total lesion volume control.

Discussion

By bringing together experimental psychology, cognitive neurology and neuroimaging methods, we have identified two divisions in the cognitive and neural organization of spoken language processing. The factor analysis results provide important new behavioural evidence of dissociation between semantic and phonological processes and between input and output processes. The first division corresponds to a set of peri-Sylvian regions for phonological processing and a separate set of extra-Sylvian regions for semantic processing. The peri-Sylvian regions involved in phonological processing were further subdivided into supra-Sylvian regions for speech production and infra-Sylvian regions for speech recognition. The extra-Sylvian regions involved in semantic processing were also divided between production and recognition processes. Impairment of semantic production, reflected in semantic errors, was strongly associated with left ATL lesions, whereas multimodal semantic recognition deficits were associated with impaired connectivity between the frontal lobe and other brain regions involved in semantic processing.

The peri-Sylvian phonological processing regions were broadly consistent with dual-pathway models of speech processing6,8,31,32,33 that propose a dorsal, temporal–parietal–frontal route for speech production and a ventral, temporal–frontal route for speech recognition and comprehension. Existing versions of this dual-stream framework differ in their claims regarding the anatomical structure of the streams, and the present data provide new insights to constrain these models. In the present study, the dorsal speech production route extends superior to the Sylvian fissure, from the supramarginal gyrus through inferior postcentral and precentral sensorimotor regions to premotor cortical regions involved in articulatory motor control. These results converge with previous findings implicating these areas in speech production tasks such as word repetition (after controlling for word recognition31,33,34) and in the production of phonological errors in picture naming32. We did not find evidence to support the inclusion of inferior prefrontal cortex (Broca’s area), posterior planum temporale or posterior superior temporal gyrus (Wernicke’s area) in the dorsal speech production route. According to one influential dual-pathways model6, the dorsal stream, inclusive of these areas, subserves auditory-motor integration functions essential to speech production and some speech recognition tasks. Our findings support the involvement of planum temporale and Wernicke’s area in speech recognition, but as components of the ventral route, which our VLSM of Speech Recognition locates deep and inferior to the Sylvian fissure along the length of the superior temporal gyrus. This localization of the ventral route converges with a recent meta-analysis of functional neuroimaging studies that localized speech recognition processes to the superior temporal gyrus and revealed a posterior-to-anterior progression from recognition of speech sounds to spoken words in the superior temporal lobe35.

The distinction between phonological input and output processes has been widely debated, often focusing on whether there are separate input and output lexicons36,37, and the roles of auditory speech codes in production38 and articulatory motor codes in perception39,40. Although our results do not rule out the possibility that phonological input and output functions share certain codes or resources, they highlight the fact that extensive regions of peri-Sylvian cortex are differentially specialized for one or the other function. At the same time, our results demonstrate why a behavioural input–output dissociation would be difficult to observe. First, the factor analysis showed that many tasks involve both phonological input and output processes. For example, word and nonword repetition, immediate serial recall and rhyme discrimination all loaded on both the Speech Production and Speech Recognition factors, although to different extents. One of the virtues of factor analysis is that despite the fact that many tasks may involve multiple processes, factor analysis provides a data-driven way to identify an underlying structure and compute orthogonal performance measures on each dimension for each participant. Second, the VLSM showed that the regions involved in these processes are very close to one another; thus, it would be rare to find a patient with a lesion that only affected one neural substrate and not the other. Using VLSM with a large number of participants makes it possible to study lesion–symptom relationships at a finer neuroanatomical scale than would be possible with single-case or small group studies.

The extra-Sylvian semantic processing regions also revealed a dissociation between semantically driven word production and recognition of semantic relationships in words and pictures, providing new insights into the architecture of semantic cognition. The Semantic Errors factor was associated with lesions in the ATL, consistent with other neuropsychological17,19,20 and neuroimaging41 findings that implicate this region in semantically driven retrieval of verbal labels. The ATLs have also been implicated in perceptual feature integration42 and social semantic processing43. More relevant to the present study, it has been argued that the profile of multimodal semantic deficit observed in semantic dementia10,19,44 originates from damage to ATL-localized ‘hubs’ in each hemisphere that integrate semantic information over the neurally distributed semantic network9,10,21. The behavioural and neural dissociation in the present data imposes some qualifications on this claim. The factor analysis revealed a very clear Semantic Recognition factor that combined verbal and non-verbal tests of recognition of semantic relationships or matches, similar to the multimodal semantic deficit in semantic dementia10,19,44. However, in this large group of left hemisphere stroke patients, this multimodal deficit was not associated with ATL lesions. As the production of semantic errors in picture naming was associated with ATL lesions, lack of lesion coverage in the ATL cannot explain our Semantic Recognition factor results. Rather, our results indicate that multimodal semantic deficits following unilateral left hemisphere stroke have a very different neuroanatomical basis45,46,47. Specifically, they arise from damage to a frontal white matter bottleneck—a region where the uncinate fasciculus, inferior fronto-occipital fasciculus and anterior thalamic radiations all converge. We suggest that this convergence produces a vulnerable location where a small amount of damage can have large functional consequences affecting semantic processing of both verbal and non-verbal (visual) input. Damage to this white matter bottleneck impairs connections between the inferior and middle portions of the frontal lobe and regions in the temporal, parietal and occipital lobes that are involved in semantic processing.

Our results identify the importance of connections within the distributed semantic network but do not specify the role of those connections in semantic cognition. One possibility is that disruption of these connections impairs the multimodal integration critical for semantic cognition, similar to other disconnection-based accounts of cognitive deficits13,14. Another possibility, based on the role of the frontal regions in cognitive control48,49, is that the frontal lobes serve to shape or select semantic knowledge relevant for a given task and disruption of these connections impairs semantic control45,46,47. However, this account would have to explain why the critical region is in the deep white matter underlying the frontal lobe rather than in the (pre)frontal cortex itself. It is important to stress that these results are not inconsistent with findings from functional neuroimaging that a widespread bilateral cortical network is engaged by semantic processing tasks9,21, nor are our findings incompatible with evidence that lesions to other regions of the distributed cortical network are capable of producing semantic deficits12,50,51. Rather, building on evidence that semantic cognition is supported by a widely distributed neural system, our results emphasize the importance of white matter connections for integrating and/or selecting information across this network. Specifically, our results identify a region of fibre tract convergence where a small amount of damage can impair semantic processing across multiple tasks and modalities. Outside this bottleneck region, more extensive lesions would be required to produce comparable multimodal semantic deficits; small, focal lesions would be expected to produce deficits that are more domain specific.

The behavioural dissociation of semantic errors from other measures of multimodal semantic processing has implications for cognitive models of word production, indicating that semantic errors in aphasic word production do not arise at the level of core semantic processing. Either they arise subsequent to semantic processing—in the mapping from semantics to lexical units52 or in the mapping from semantics to phonology53—or they reflect damage to semantic processes specific to word production (that is, a modality-specific semantic deficit). In either case, our finding that lesions of the left ATL are associated with semantic errors, and not multimodal semantic deficits, provides new constraints on theories of the neural basis of semantic memory. First, the superior and middle portions of the left ATL appear to be specifically critical for semantically driven word retrieval—lesions here cause semantic errors in production but do not disrupt more general multimodal semantic processing. Second, semantic cognition (both semantic representation and semantic control) cannot be reduced to cortical hubs—the white matter connections play an integral role. Our evidence shows that a white matter lesion causes multimodal semantic deficits in stroke. In semantic dementia—the paradigmatic impairment of semantic representation—the ATL is frequently the site of peak grey matter atrophy, but the neurodegeneration extends beyond ATL, including into the fronto-temporal white matter, and recent evidence shows that this white matter degeneration also contributes to the semantic deficit23,28.

We have emphasized the dissociation of semantic errors and multimodal semantic deficits, but our proposal does not require completely independent semantic systems for comprehension and production, only some functional specificity within the semantic system, such that different kinds of damage produce different kinds of deficits. Our proposal also explains why lesions in other regions known to be important for semantic processing, such as the middle and posterior portions of the middle temporal gyrus and the inferior parietal lobule (angular gyrus and supramarginal gyrus)9,24,51,54, were not associated with either semantic errors or multimodal semantics. Our data suggest that the role of these regions is neither specific to semantically driven word production (that role is played by the left ATL) nor general enough for focal damage to produce multimodal semantic deficits. In contrast, damage to the white matter bottleneck impairs connections among the widely distributed network of the left frontal–temporal–parietal regions involved in semantic cognition, thereby producing multimodal semantic deficits. The present study only included individuals with left hemisphere lesions; thus, it cannot speak to the possible hemispheric asymmetry between the ATLs, such that the left ATL is more strongly involved in verbal semantic tasks, whereas the right ATL is more involved in non-verbal (picture) semantic tasks44,53. In addition, as lesion coverage was poor in ventral and inferolateral temporal cortex, we cannot rule out bilaterally redundant multimodal semantic hubs in those sectors of the ATL55, but we can rule out damage to such hubs as an account of the multimodal semantic recognition deficit observed in aphasia following left hemisphere stroke. Finally, the present results do not identify critical sub-regions within the functionally and anatomically heterogeneous inferior and middle portions of the frontal lobe56,57.

In conclusion, studies of patients with persistent cognitive deficits form the foundation of cognitive neuroscience, but such patients can be idiosyncratic and typically do not allow precise anatomical conclusions. Contemporary neuroimaging techniques offer a way to study the neural basis of cognitive processes on a wider scale and with finer anatomical precision, but it can be difficult to conclusively distinguish task-critical and ancillary neural (or hemodynamic) responses. The present study drew on the strengths of these distinct methods by combining broad and deep behavioural assessment of left hemisphere stroke patients with high-quality structural neuroimaging analysis techniques. The results reveal the functional and neural architecture of the language system with an unprecedented degree of neuroanatomical precision and offer a novel synthesis of the traditional separation of receptive and expressive language with the contemporary emphasis on primary systems.

Methods

Participants

Participants were drawn from an ongoing project investigating the anatomical basis of psycholinguistic deficits in post-acute aphasia. Results from this project and some of these participants have been reported in several previous publications17,18,32,34,54,58. In particular, the original demonstration that semantic errors in naming localize to the left ATL was based on 64 patients from the current group of 99 (refs 17, 18). To be included in this study, participants had to be at least 1 month post onset of aphasia secondary to stroke, living at home, medically stable without major psychiatric or neurological co-morbidities and have been premorbidly right handed. Participants were also required to have English as the primary language, adequate vision and hearing (with or without correction) and computed tomography (CT) or magnetic resonance imaging (MRI) confirmed left hemisphere cortical lesion. Only participants who had completed all 17 tests were included in this study. All participants gave informed consent to take part in a multisession language assessment under protocols approved by the Institutional Review Boards at the Albert Einstein Medical Center and University of Pennsylvania School of Medicine. The sample consisted of 43 women and 56 men, 48 African Americans and 51 Caucasians. They averaged 58 years of age (s.d.=11; range=26–79), 14 years of education (s.d.=3; range=10–21) and 53 months post onset of stroke (s.d.=68; range=1–381). Eighty-three per cent were in the chronic phase (>6 months.) The predominant subtype diagnosis was anomic aphasia (44%), followed by Broca’s aphasia (27%) and conduction aphasia (16%). The Aphasia Quotient, which rates overall severity on a scale from 1 (most severe) to 100, averaged 73 (s.d.=18.4; range=27.2–97.9).

Language tests

Participants completed a multi-session battery of psycholinguistic tests, primarily focused on word-level processing, from speech perception to verbal and non-verbal semantic processing. Here we provide a brief description along with mean, s.d. and range of performance for each test. A more detailed description of the battery has been provided previously15.

Factor analysis

Performance of the 99 included participants on the 17 measures was subjected to principal components analysis with varimax rotation to produce orthogonal factors that, in the limit, would preserve all of the variance in the original data. The standard Kaiser criterion (extract factors with eigenvalue >1.0) was used to determine which factors captured meaningful variance in the data. This produced a three-factor model that captured 70% of the variance in the original data. The fourth factor consisted almost entirely of semantic errors, which did not load strongly on any of the three factors (all loadings <0.4) and the participants’ factor scores for the first three factors were virtually identical under the three-factor and four-factor models (_r_>0.97 for each of the three factors). As these factor scores were the behavioural measures for the VLSM analyses, the three-factor and four-factor models would produce virtually identical VLSM results. We included this semantic errors factor in the analyses, because doing so would have virtually no impact on the other results and would be a useful comparison for factor 1 (Semantic Recognition) and with previous VLSM analyses of semantic errors.

Lesion analysis

Research brain scans were acquired for 87 participants (50 MRI and 37 CT). High-resolution whole-brain T1-weighted images (magnetization-prepared rapid acquisition gradient echo) were acquired for the 50 participants undergoing MRI. Of these, 44 were scanned on a 3-T Siemens Trio scanner (repetition time=1,620 ms, echo time=3.87 ms, field of view=192 × 256 mm, 1 × 1 × 1 mm3 voxels). As medical implants were not approved for the higher strength magnetic field, six participants were scanned instead on a 1.5-T Siemens Sonata (repetition time=3,000 ms, echo time=3.54 ms, field of view=24 cm, 1.25 × 1.25 × 1.2-mm voxels). For 37 participants who were not eligible for MRI scanning, whole-brain CT scans without contrast (60 axial slices, 3 mm thick) were acquired. Twelve additional participants declined scanning; for these participants, recent clinical scans (CT (_n_=8) and MRI (_n_=4)) with clearly delineated lesion boundaries were substituted in the lesion tracing procedure.

Lesions were manually segmented on the structural image by a trained technician or experienced neurologist, both of whom were blinded to the behavioural data. The lesion maps drawn by the technician were reviewed by the experienced neurologist. MRI structural scans were registered to a custom template constructed from images acquired on the same scanner and then from this intermediate template to the Montreal Neurological Institute space ‘Colin27’ volume. Lesions imaged with CT were drawn by the experienced neurologist directly onto the Colin27 volume, after rotating (pitch only) the template to approximate the slice plane of the patient’s scan (these procedures have been used in several previous studies17,32). The lesion overlap map for the 99 qualified participants in the left hemisphere is shown in Supplementary Fig. 1. Anatomical alignment of lesions does not guarantee functional alignment due to individual differences in functional organization and re-organization following stroke; however, large-scale studies such as this one provide the best evidence regarding aspects of functional organization that are consistent across individuals.

VLSM analysis was performed for each factor. Only voxels lesioned in at least 10 participants were included in analysis, because tests of voxels where <10% of the participant sample has lesions would produce unacceptably unstable results. VLSM analysis was performed by running a simple regression analysis at each voxel, with the lesion status as the independent variable and the factor score as the dependent variable. To control the effect of total lesion volume, each lesion map was normalized to have a unit norm. After normalization, the lesion status of each subject equals either 0 (no lesion on this voxel) or the reciprocal of the norm of the lesion map, that is, 1/(square root of total lesion volume). This normalization process was adopted from a multivariate lesion–symptom mapping method67, where the lesion maps were normalized to have a norm of 1 to stabilize data processing. As total lesion volume is a big positive number, it is highly correlated to its square root (_r_>0.99 for a random series); hence, the normalization is nearly the same as setting the lesion status to be 1/(total lesion volume). We call this approach ‘direct total lesion volume control’. After direct total lesion volume control, greater weight was placed on lesioned voxels when the total lesion volume was smaller than when it was larger.

General linear model from SPM8 package ( www.fil.ion.ucl.ac.uk/spm/, Wellcome Institute of Imaging Neuroscience, London, UK) was used to model the correlation between lesion status for each voxel and the factor scores. The general linear model coefficient β was used to measure the relative importance of each voxel to each factor. The VLSM β-values obtained from the genuine order of factor score were compared to those obtained by 1000 permutations of the factor score at each voxel, and the number of permutations yielding higher VLSM β-value than the genuine one was divided by 1001 to get the permutation _p_-value. The derived statistical _p_-map was thresholded with FDR _q_=0.05 (Semantic Recognition factor was thresholded with FDR _q_=0.1) and isolated clusters with voxel number no more than 50 after thresholding were removed. As a check, an alternative family-wise cluster correction method68 was also used to determine a cluster size threshold by permuting the lesion–behaviour (factor score) relations (3,000 permutations), setting the voxelwise threshold to P<0.001 (uncorrected) and computing the minimum cluster size that would have a <5% likelihood of being exceeded by chance. This permutation-based family-wise cluster correction method produced the same pattern of results as the FDR correction; details of the method are provided in the Supplementary Methods along with figures showing the results (Supplementary Figs 2–4). The white matter tracts in Fig. 3 were based on the ICBM-DTI white matter tractography atlas from FSL ( http://fsl.fmrib.ox.ac.uk/fsl/fslwiki/Atlases)27,69,70 using a 20% probability threshold.

Additional information

How to cite this article: Mirman, D. et al. Neural organization of spoken language revealed by lesion–symptom mapping. Nat. Commun. 6:6762 doi: 10.1038/ncomms7762 (2015).

References

  1. Lichtheim, L. On aphasia. Brain 7, 433–484 (1885).
    Article Google Scholar
  2. Geschwind, N. The organization of language and the brain. Science 170, 940–944 (1970).
    Article CAS ADS Google Scholar
  3. Poeppel, D. & Hickok, G. S. Towards a new functional anatomy of language. Cognition 92, 1–12 (2004).
    Article Google Scholar
  4. Patterson, K. & Lambon Ralph, M. A. Selective disorders of reading? Curr. Opin. Neurobiol. 9, 235–239 (1999).
    Article CAS Google Scholar
  5. Menenti, L., Gierhan, S. M. E., Segaert, K. & Hagoort, P. Shared language: overlap and segregation of the neuronal infrastructure for speaking and listening revealed by functional MRI. Psychol. Sci. 22, 1173–1182 (2011).
    Article Google Scholar
  6. Hickok, G. S. & Poeppel, D. The cortical organization of speech processing. Nat. Rev. Neurosci. 8, 393–402 (2007).
    Article CAS Google Scholar
  7. Hickok, G. S. & Poeppel, D. Dorsal and ventral streams: a framework for understanding aspects of the functional anatomy of language. Cognition 92, 67–99 (2004).
    Article Google Scholar
  8. Rauschecker, J. P. & Scott, S. K. Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing. Nat. Neurosci. 12, 718–724 (2009).
    Article CAS Google Scholar
  9. Binder, J. R. & Desai, R. H. The neurobiology of semantic memory. Trends Cogn. Sci. 15, 527–536 (2011).
    Article Google Scholar
  10. Patterson, K. E., Nestor, P. J. & Rogers, T. T. Where do you know what you know? The representation of semantic knowledge in the human brain. Nat. Rev. Neurosci. 8, 976–987 (2007).
    Article CAS Google Scholar
  11. Damasio, H., Tranel, D., Grabowski, T., Adolphs, R. & Damasio, A. R. Neural systems behind word and concept retrieval. Cognition 92, 179–229 (2004).
    Article CAS Google Scholar
  12. Dronkers, N. F., Wilkins, D. P., Van Valin, R. D., Redfern, B. B. & Jaeger, J. J. Lesion analysis of the brain areas involved in language comprehension. Cognition 92, 145–177 (2004).
    Article Google Scholar
  13. Catani, M. & Mesulam, M.-M. The arcuate fasciculus and the disconnection theme in language and aphasia: History and current state. Cortex 44, 953–961 (2008).
    Article Google Scholar
  14. Catani, M. & Ffytche, D. H. The rises and falls of disconnection syndromes. Brain 128, 2224–2239 (2005).
    Article Google Scholar
  15. Mirman, D. et al. A large, searchable, web-based database of aphasic performance on picture naming and other tests of cognitive function. Cogn. Neuropsychol. 27, 495–504 (2010).
    Article Google Scholar
  16. Bates, E. et al. Voxel-based lesion-symptom mapping. Nat. Neurosci. 6, 448–450 (2003).
    Article CAS Google Scholar
  17. Schwartz, M. F. et al. Anterior temporal involvement in semantic word retrieval: voxel-based lesion-symptom mapping evidence from aphasia. Brain 132, 3411–3427 (2009).
    Article Google Scholar
  18. Walker, G. M. et al. Support for anterior temporal involvement in semantic error production in aphasia: new evidence from VLSM. Brain Lang. 117, 110–122 (2011).
    Article Google Scholar
  19. Mesulam, M.-M. et al. Neurology of anomia in the semantic variant of primary progressive aphasia. Brain 132, 2553–2565 (2009).
    Article Google Scholar
  20. Mesulam, M.-M. et al. Words and objects at the tip of the left temporal lobe in primary progressive aphasia. Brain 136, 601–618 (2013).
    Article Google Scholar
  21. Martin, A. The representation of object concepts in the brain. Annu. Rev. Psychol. 58, 25–45 (2007).
    Article Google Scholar
  22. Visser, M., Jefferies, E. & Lambon Ralph, M. A. Semantic processing in the anterior temporal lobes: a meta-analysis of the functional neuroimaging literature. J. Cogn. Neurosci. 22, 1083–1094 (2010).
    Article CAS Google Scholar
  23. Guo, C. C. et al. Anterior temporal lobe degeneration produces widespread network-driven dysfunction. Brain 136, 2979–2991 (2013).
    Article Google Scholar
  24. Seghier, M. L. The angular gyrus: multiple functions and multiple subdivisions. Neuroscientist 19, 43–61 (2013).
    Article Google Scholar
  25. Catani, M. & de Schotten, M. T. Atlas of Human Brain Connections 519, Oxford University Press (2012).
  26. Rilling, J. K. et al. The evolution of the arcuate fasciculus revealed with comparative DTI. Nat. Neurosci. 11, 426–428 (2008).
    Article CAS Google Scholar
  27. Mori, S., Wakana, S., Zijl van, P. C. M. & Nagae-Poetscher, L. M. MRI Atlas of Human White Matter 276, Elsevier (2005).
  28. Han, Z. et al. White matter structural connectivity underlying semantic processing: evidence from brain damaged patients. Brain 136, 2952–2965 (2013).
    Article Google Scholar
  29. Kümmerer, D. et al. Damage to ventral and dorsal language pathways in acute aphasia. Brain 136, 619–629 (2013).
    Article Google Scholar
  30. Moritz-Gasser, S., Herbet, G. & Duffau, H. Mapping the connectivity underlying multimodal (verbal and non-verbal) semantic processing: a brain electrostimulation study. Neuropsychologia 51, 1814–1822 (2013).
    Article Google Scholar
  31. Buchsbaum, B. R. et al. Conduction aphasia, sensory-motor integration, and phonological short-term memory - an aggregate analysis of lesion and fMRI data. Brain Lang. 119, 119–128 (2011).
    Article Google Scholar
  32. Schwartz, M. F., Faseyitan, O., Kim, J. & Coslett, H. B. The dorsal stream contribution to phonological retrieval in object naming. Brain 135, 3799–3814 (2012).
    Article Google Scholar
  33. Fridriksson, J. et al. Impaired speech repetition and left parietal lobe damage. J. Neurosci. 30, 11057–11061 (2010).
    Article CAS Google Scholar
  34. Dell, G. S., Schwartz, M. F., Nozari, N., Faseyitan, O. & Coslett, H. B. Voxel-based lesion-parameter mapping: Identifying the neural correlates of a computational model of word production. Cognition 128, 380–396 (2013).
    Article Google Scholar
  35. DeWitt, I. & Rauschecker, J. P. Phoneme and word recognition in the auditory ventral stream. Proc. Natl Acad. Sci. USA 109, E505–E514 (2012).
    Article CAS ADS Google Scholar
  36. Gow, D. W. The cortical organization of lexical knowledge: A dual lexicon model of spoken language processing. Brain Lang. 121, 273–288 (2012).
    Article Google Scholar
  37. Caramazza, A. & Hillis, A. E. Lexical organization of nouns and verbs in the brain. Nature 349, 788–790 (1991).
    Article CAS ADS Google Scholar
  38. Hickok, G. S. Computational neuroanatomy of speech production. Nat. Rev. Neurosci. 13, 135–145 (2012).
    Article CAS Google Scholar
  39. Pulvermüller, F. et al. Motor cortex maps articulatory features of speech sounds. Proc. Natl Acad. Sci. USA 103, 7865–7870 (2006).
    Article ADS Google Scholar
  40. Lotto, A. J., Hickok, G. S. & Holt, L. L. Reflections on mirror neurons and speech perception. Trends Cogn. Sci. 13, 110–114 (2009).
    Article Google Scholar
  41. Indefrey, P. & Levelt, W. J. M. The spatial and temporal signatures of word production components. Cognition 92, 101–144 (2004).
    Article CAS Google Scholar
  42. Baron, S. G., Thompson-Schill, S. L., Weber, M. & Osherson, D. An early stage of conceptual combination: superimposition of constituent concepts in left anterolateral temporal lobe. Cogn. Neurosci. 1, 44–51 (2010).
    Article Google Scholar
  43. Olson, I. R., McCoy, D., Klobusicky, E. & Ross, L. A. Social cognition and the anterior temporal lobes: a review and theoretical framework. Soc. Cogn. Affect. Neurosci. 8, 123–133 (2013).
    Article Google Scholar
  44. Butler, C. R., Brambati, S. M., Miller, B. L. & Gorno-Tempini, M. L. The neural correlates of verbal and nonverbal semantic processing deficits in neurodegenerative disease. Cogn. Behav. Neurol. 22, 73–80 (2009).
    Article Google Scholar
  45. Jefferies, E. & Lambon Ralph, M. A. Semantic impairment in stroke aphasia versus semantic dementia: A case-series comparison. Brain 129, 2132–2147 (2006).
    Article Google Scholar
  46. Jefferies, E. The neural basis of semantic cognition: converging evidence from neuropsychology, neuroimaging and TMS. Cortex 49, 611–625 (2013).
    Article Google Scholar
  47. Mirman, D. & Britt, A. E. What we talk about when we talk about access deficits. Philos. Trans. R. Soc. B Biol. Sci. 369, 1–14 (2014).
    Google Scholar
  48. Badre, D. & Wagner, A. D. Left ventrolateral prefrontal cortex and the cognitive control of memory. Neuropsychologia 45, 2883–2901 (2007).
    Article Google Scholar
  49. Thompson-Schill, S. L., Bedny, M. & Goldberg, R. F. The frontal lobes and the regulation of mental activity. Curr. Opin. Neurobiol. 15, 219–224 (2005).
    Article CAS Google Scholar
  50. Buxbaum, L. J. & Kalénine, S. Action knowledge, visuomotor activation, and embodiment in the two action systems. Ann. N. Y. Acad. Sci. 1191, 201–218 (2010).
    Article ADS Google Scholar
  51. Mirman, D. & Graziano, K. M. Damage to temporo-parietal cortex decreases incidental activation of thematic relations during spoken word comprehension. Neuropsychologia 50, 1990–1997 (2012).
    Article Google Scholar
  52. Schwartz, M. F., Dell, G. S., Martin, N., Gahl, S. & Sobel, P. A case-series test of the interactive two-step model of lexical access: evidence from picture naming. J. Mem. Lang. 54, 228–264 (2006).
    Article Google Scholar
  53. Lambon Ralph, M. A., McClelland, J. L., Patterson, K. E., Galton, C. J. & Hodges, J. R. No right to speak? The relationship between object naming and semantic impairment: neuropsychological evidence and a computational model. J. Cogn. Neurosci. 13, 341–356 (2001).
    Article CAS Google Scholar
  54. Schwartz, M. F. et al. A neuroanatomical dissociation for taxonomic and thematic knowledge in the human brain. Proc. Natl Acad. Sci. 108, 8520–8524 (2011).
    Article CAS ADS Google Scholar
  55. Lambon Ralph, M. A. Neurocognitive insights on conceptual knowledge and its breakdown. Philos. Trans. R. Soc. B Biol. Sci. 369, 20120392 (2014).
    Article Google Scholar
  56. Fedorenko, E., Duncan, J. & Kanwisher, N. Language-selective and domain-general regions lie side by side within Broca’s area. Curr. Biol. 22, 2059–2062 (2012).
    Article CAS Google Scholar
  57. Keller, S. S., Crow, T., Foundas, A., Amunts, K. & Roberts, N. Broca’s area: nomenclature, anatomy, typology and asymmetry. Brain Lang. 109, 29–48 (2009).
    Article Google Scholar
  58. Mirman, D. & Graziano, K. M. The neural basis of inhibitory effects of semantic and phonological neighbors in spoken word production. J. Cogn. Neurosci 25, 1504–1516 (2013).
    Article Google Scholar
  59. Bozeat, S., Lambon Ralph, M. A., Patterson, K. E., Garrard, P. & Hodges, J. R. Non-verbal semantic impairment in semantic dementia. Neuropsychologia 38, 1207–1215 (2000).
    Article CAS Google Scholar
  60. Howard, D. & Patterson, K. E. Pyramids and Palm Trees: A Test of Semantic Access From Pictures and Words Thames Valley Test Company (1992).
  61. Martin, N., Schwartz, M. F. & Kohen, F. P. Assessment of the ability to process semantic and phonological aspects of words in aphasia: a multi-measurement approach. Aphasiology 20, 154–166 (2006).
    Article Google Scholar
  62. Freedman, M. L. & Martin, R. C. Dissociable components of short-term memory and their relation to long-term learning. Cogn. Neuropsychol. 18, 193–226 (2001).
    Article CAS Google Scholar
  63. Dunn, L. M. & Dunn, L. M. Examiner’s Manual for the Peabody Picture Vocabulary Test-III (PPVT-III) American Guidance Service (1997).
  64. Roach, A., Schwartz, M. F., Martin, N., Grewal, R. S. & Brecher, A. R. The Philadelphia naming test: scoring and rationale. Clin. Aphasiol. 24, 121–133 (1996).
    Google Scholar
  65. Martin, R. C., Shelton, J. R. & Yaffee, L. S. Language processing and working memory: neuropsychological evidence for separate phonological and semantic capacities. J. Mem. Lang. 33, 83–111 (1994).
    Article Google Scholar
  66. Kay, J., Lesser, R. & Coltheart, M. Psycholinguistic assessments of language processing in aphasia (PALPA): an introduction. Aphasiology 10, 159–180 (1996).
    Article Google Scholar
  67. Zhang, Y., Kimberg, D. Y., Coslett, H. B., Schwartz, M. F. & Wang, Z. Multivariate lesion-symptom mapping using support vector regression. Hum. Brain Mapp. 35, 5861–5876 (2014).
    Article Google Scholar
  68. Pillay, S. B., Stengel, B. C., Humphries, C., Book, D. S. & Binder, J. R. Cerebral localization of impaired phonological retrieval during rhyme judgment. Ann. Neurol. 76, 738–746 (2014).
    Article Google Scholar
  69. Wakana, S. et al. Reproducibility of quantitative tractography methods applied to cerebral white matter. Neuroimage 36, 630–644 (2007).
    Article Google Scholar
  70. Hua, K. et al. Tract probability maps in stereotaxic spaces: analyses of white matter anatomy and tract-specific quantification. Neuroimage 39, 336–347 (2008).
    Article Google Scholar

Download references

Acknowledgements

This research was supported by National Institutes of Health grants R01DC010805 to D.M. and R01DC000191 to M.F.S. We thank Adelyn Brecher and Gabriella Garcia for their contributions to participant recruitment and testing, Grant Walker and Kristen Graziano for their work on lesion segmentation and Dan Kimberg for his contributions to a preliminary version of these analyses.

Author information

Authors and Affiliations

  1. Moss Rehabilitation Research Institute, 50 Township Line Road, Elkins Park, 19027, Pennsylvania, USA
    Daniel Mirman, Qi Chen, H. Branch Coslett & Myrna F. Schwartz
  2. Department of Psychology, Drexel University, 3141 Chestnut Street, Philadelphia, 19104, Pennsylvania, USA
    Daniel Mirman
  3. Center for Studies of Psychological Application and School of Psychology, South China Normal University, Guangzhou, 510631, China
    Qi Chen
  4. University of Pennsylvania, 3400 Spruce Street, Philadelphia, 19104, Pennsylvania, USA
    Yongsheng Zhang, Ze Wang, Olufunsho K. Faseyitan & H. Branch Coslett
  5. Center for Cognition and Brain Disorders, Hangzhou Normal University, Hangzhou, 310005, Zhejiang Province, China
    Ze Wang

Authors

  1. Daniel Mirman
  2. Qi Chen
  3. Yongsheng Zhang
  4. Ze Wang
  5. Olufunsho K. Faseyitan
  6. H. Branch Coslett
  7. Myrna F. Schwartz

Contributions

The overall study idea was conceived and supervised by M.F.S. The factor analysis was carried out by D.M. and Q.C. The lesion analysis was carried out by Q.C., Y.Z., Z.W., O.K.F. and H.B.C., and interpreted with the other authors. D.M., M.F.S. and H.B.C. wrote the manuscript with input from the other authors.

Corresponding authors

Correspondence toDaniel Mirman or Myrna F. Schwartz.

Ethics declarations

Competing interests

The authors declare no competing financial interests.

Supplementary information

Rights and permissions

About this article

Cite this article

Mirman, D., Chen, Q., Zhang, Y. et al. Neural organization of spoken language revealed by lesion–symptom mapping.Nat Commun 6, 6762 (2015). https://doi.org/10.1038/ncomms7762

Download citation