Nikola Vukovic | University of Cambridge (original) (raw)

Papers by Nikola Vukovic

The factors that contribute to perceptual simulation during sentence comprehension remain underex... more The factors that contribute to perceptual simulation during sentence comprehension remain underexplored. Extant research on perspective taking in language has largely focused on linguistic constraints, such as the role of pronouns in guiding perspective adoption. In the present study, we identify preferential usage of egocentric and allocentric reference frames in individuals, and test the two groups on a standard sentence-picture verification task. Across three experiments, we show that individual biases in spatial reference frame adoption observed in non-linguistic tasks influence visual simulation of perspective in language. Our findings suggest that typically reported grand-averaged effects may obscure important between-subject differences, and support proposals arguing for representational pluralism, where perceptual information is integrated dynamically and in a way that is sensitive to contextual and especially individual constraints.

NeuroImage, Nov 15, 2014

Understanding neurocognitive mechanisms supporting the use of multiple languages is a key questio... more Understanding neurocognitive mechanisms supporting the use of multiple languages is a key question in language science. Recent neuroimaging studies in monolinguals indicated that core language areas in human neocortex together with sensorimotor structures form a highly interactive system underpinning native language comprehension. While the experience of a native speaker promotes the establishment of strong action–perception links in the comprehension network, this may not necessarily be the case for L2 where, as it has been argued, the most a typical L2 speaker may get is a link between an L2 wordform and its L1 translation equivalent. Therefore, we investigated, whether the motor cortex of bilingual subjects shows differential involvement in processing action semantics of native and non-native words. We used high-density EEG to dynamically measure changes in the cortical motor system's activity, indexed by event-related desynchronisation (ERD) of the mu-rhythm, in response to passively reading L1 (German) and L2 (English) action words. Analysis of motor-related EEG oscillations at the sensor level revealed an early (starting ~ 150 ms) and left-lateralised coupling between action and semantics during both L1 and L2 processing. Crucially, source-level activation in the motor areas showed that mu-rhythm ERD, while present for both languages, is significantly stronger for L1 words. This is the first neurophysiological evidence of rapid motor-cortex involvement during L2 action–semantic processing. Our results both strengthen embodied cognition evidence obtained previously in monolinguals and, at the same time, reveal important quantitative differences between L1 and L2 sensorimotor brain activity in language comprehension.

Society for the Neurobiology of Language Conference, Aug 28, 2014

Acta Psychologica, Jan 1, 2014

Research supports the claim that, when understanding language, people perform mental simulation u... more Research supports the claim that, when understanding language, people perform mental simulation using those parts of the brain which support sensation, action, and emotion. A major criticism of the findings quoted as evidence for embodied simulation, however, is that they could be a result of conscious image generation strategies. Here we exploit the well-known fact that bilinguals routinely and automatically activate both their languages during comprehension to test whether this automatic process is, in turn, modulated by embodied simulatory processes. Dutch participants heard English sentences containing interlingual homophones and implying specific distance relations, and had to subsequently respond to pictures of objects matching or mismatching this implied distance. Participants were significantly slower to reject critical items when their perceptual features matched said distance relationship. These results suggest that bilinguals not only activate task-irrelevant meanings of interlingual homophones, but also automatically simulate these meanings in a detailed perceptual fashion. Our study supports the claim that embodied simulation is not due to participants' conscious strategies, but is an automatic component of meaning construction.

35th Annual Meeting of the Cognitive Science Society, 2013

The factors that contribute to perceptual simulation during sentence comprehension remain underex... more The factors that contribute to perceptual simulation during sentence comprehension remain underexplored. Extant research on perspective taking in language has largely focused on linguistic constraints, such as the role of pronouns in guiding perspective adoption. In the present study, we identify preferential usage of egocentric and allocentric reference frames in individuals, and test the two groups on a standard sentence-picture verification task. Across three experiments, we show that individual biases in spatial reference frame adoption observed in non-linguistic tasks influence visual simulation of perspective in language. Our findings suggest that typically reported grand-averaged effects may obscure important between-subject differences, and support proposals arguing for representational pluralism, where perceptual information is integrated dynamically and in a way that is sensitive to contextual and especially individual constraints.

NeuroImage, Nov 15, 2014

Understanding neurocognitive mechanisms supporting the use of multiple languages is a key questio... more Understanding neurocognitive mechanisms supporting the use of multiple languages is a key question in language science. Recent neuroimaging studies in monolinguals indicated that core language areas in human neocortex together with sensorimotor structures form a highly interactive system underpinning native language comprehension. While the experience of a native speaker promotes the establishment of strong action–perception links in the comprehension network, this may not necessarily be the case for L2 where, as it has been argued, the most a typical L2 speaker may get is a link between an L2 wordform and its L1 translation equivalent. Therefore, we investigated, whether the motor cortex of bilingual subjects shows differential involvement in processing action semantics of native and non-native words. We used high-density EEG to dynamically measure changes in the cortical motor system's activity, indexed by event-related desynchronisation (ERD) of the mu-rhythm, in response to passively reading L1 (German) and L2 (English) action words. Analysis of motor-related EEG oscillations at the sensor level revealed an early (starting ~ 150 ms) and left-lateralised coupling between action and semantics during both L1 and L2 processing. Crucially, source-level activation in the motor areas showed that mu-rhythm ERD, while present for both languages, is significantly stronger for L1 words. This is the first neurophysiological evidence of rapid motor-cortex involvement during L2 action–semantic processing. Our results both strengthen embodied cognition evidence obtained previously in monolinguals and, at the same time, reveal important quantitative differences between L1 and L2 sensorimotor brain activity in language comprehension.

Society for the Neurobiology of Language Conference, Aug 28, 2014

Acta Psychologica, Jan 1, 2014

Research supports the claim that, when understanding language, people perform mental simulation u... more Research supports the claim that, when understanding language, people perform mental simulation using those parts of the brain which support sensation, action, and emotion. A major criticism of the findings quoted as evidence for embodied simulation, however, is that they could be a result of conscious image generation strategies. Here we exploit the well-known fact that bilinguals routinely and automatically activate both their languages during comprehension to test whether this automatic process is, in turn, modulated by embodied simulatory processes. Dutch participants heard English sentences containing interlingual homophones and implying specific distance relations, and had to subsequently respond to pictures of objects matching or mismatching this implied distance. Participants were significantly slower to reject critical items when their perceptual features matched said distance relationship. These results suggest that bilinguals not only activate task-irrelevant meanings of interlingual homophones, but also automatically simulate these meanings in a detailed perceptual fashion. Our study supports the claim that embodied simulation is not due to participants' conscious strategies, but is an automatic component of meaning construction.

35th Annual Meeting of the Cognitive Science Society, 2013