Sebo Uithol | Leiden University (original) (raw)

Published Papers by Sebo Uithol

Research paper thumbnail of Sebo Uithol Curriculum Vitae

Research paper thumbnail of Embodying the camera: An EEG study on the effect of camera movements on film spectators´sensorimotorspectators´sensorimotor cortex activation

One key feature of film consists in its power to bodily engage the viewer. Previous research has ... more One key feature of film consists in its power to bodily engage the viewer. Previous research has suggested lens and camera movements to be among the most effective stylistic devices involved in such engagement. In an EEG experiment we assessed the role of such movements in modulating specific spectators´neuralspectators´neural and experiential responses, likely reflecting such engagement. We produced short video clips of an empty room with a still, a zooming and a moving camera (steadicam) that might simulate the movement of an observer in different ways. We found an event related desynchronization of the beta components of the rolandic mu rhythm that was stronger for the clips produced with steadicam than for those produced with a still or zooming camera. No equivalent modulation in the attention related occipital areas was found, thus confirming the sensorimotor nature of spectators´neuralspectators´neural responses to the film clips. The present study provides the first empirical evidence that filmic means such as camera movements alone can modulate spectators' bodily engagement with film.

Research paper thumbnail of Disentangling causal webs in the brain using functional magnetic resonance imaging: A review of current approaches

In the past two decades, functional Magnetic Resonance Imaging (fMRI) has been used to relate neu... more In the past two decades, functional Magnetic Resonance Imaging (fMRI) has been used to relate neuronal network activity to cognitive processing and behavior. Recently this approach has been augmented by algorithms that allow us to infer causal links between component populations of neuronal networks. Multiple inference procedures have been proposed to approach this research question but so far, each method has limitations when it comes to establishing whole-brain connectivity patterns. In this paper, we discuss eight ways to infer causality in fMRI research: Bayesian Nets, Dynamical Causal Modelling, Granger Causality, Likelihood Ratios, Linear Non-Gaussian Acyclic Models, Patel's Tau, Structural Equation Modelling, and Transfer Entropy. We finish with formulating some recommendations for the future directions in this area.

Research paper thumbnail of Reckoning the moment of reckoning in spontaneous voluntary movement

Proceedings of the National Academy of the Sciences, 2016

Research paper thumbnail of The Role of the Body in Social Cognition

WIREs Cognitive Science

In this review we discuss the actual and active dependence of social cognitive processes on the b... more In this review we discuss the actual and active dependence of social cognitive processes on the body, i.e. that part of the organism beyond the central nervous system. In particular, we will discuss mirror mechanisms, and assess the extent to which the body is recruited during these processes. We show that for emotion mirroring this dependency is well documented, but for action mirroring far less so. By reviewing these mechanisms and processes while contrasting body from brain, and social from general cognition, we show that both contrasts are arbitrary and problematic and that any study of cognitive processes, both social and general, should take the body into account.

Research paper thumbnail of Engagement: Looking beyond the mirror to understand action understanding

British Journal of Developmental Psychology

In this paper we argue that the current focus on mirroring as the route to explaining the develop... more In this paper we argue that the current focus on mirroring as the route to explaining the development of action understanding is misleading and problematic. It facilitates a fundamentally spectatorial stance, ignoring engagement and dialogue; it focuses on similarity between self and other and neglects difference; and it succumbs to the static terminology of mechanism rather than a dynamic language of process. Contrary to this view, dialogic exchanges are evident from the start of life, revealing the infants’ ability to engage with and respond appropriately to actions that are outside their own motor repertoire. We suggest that engagement rather than mirroring better accounts for many current findings in action understanding. The neurological evidence to date shows that action perception involves a process of continuous synchronisation and change, suggesting that it might be more fruitful for research and theory to look beyond mirroring and instead adopt dynamic processual explanations of action understanding within interaction.

Research paper thumbnail of Single-pulse transcranial magnetic stimulation reveals contribution of premotor cortex to object shape recognition

Brain Stimulation (in press)

Background It is known that ventral premotor cortex responds selectively to the visual perceptio... more Background
It is known that ventral premotor cortex responds selectively to the visual perception of object shapes. However, it is unclear whether this activation also contributes to visual processing.

Objective
In this study we want to assess whether activation in premotor areas contributes to visual perception of objects.

Methods
We measure performance on a perception task while delivering single pulse transcranial magnetic stimulation (TMS) to the left premotor cortex at different latencies after stimulus onset.

Results
We show that in cases of limited visual consciousness, disturbing the left premotor cortex 150 ms after stimulus onset results in a decrease in the capacity to recognize shapes, compared both to other latencies and to stimulation of the vertex.

Conclusion
Premotor cortex plays a constitutive role in object shape recognition.

Research paper thumbnail of Participation over observation: The roots of action understanding in attunement

Research paper thumbnail of No need to match: A comment on Bach, Nicholson and Hudson’s ‘Affordance-Matching Hypothesis’

Research paper thumbnail of How action selection can be embodied: intracranial gamma band recording shows response competition during the Eriksen flankers test

Frontiers in Human Neuroscience, Aug 26, 2014

Recent findings in monkeys suggest that action selection is based on a competition between variou... more Recent findings in monkeys suggest that action selection is based on a competition between various action options that are automatically planned by the motor system. Here we discuss data from intracranial EEG recordings in human premotor cortex during a bimanual version of the Eriksen flankers test that suggest that the same principles apply to human action decisions. Recording sites in the dorsal premotor cortex show an early but undifferentiated activation, a delayed response that depends on the experimental conditions and, finally, a movement related activation during action execution. Additionally, we found that the medial part of the premotor cortex show a significant increase in response for ipsilateral trials, suggesting a role in inhibiting the wrong response. The ventral premotor cortex seems to be involved in action execution, rather than action selection. Together these findings suggest that the human premotor cortex is part of a network that specifies, selects, and executes actions.

Research paper thumbnail of Nowhere and everywhere: the causal origin of voluntary action

The idea that prior intentions make the difference between intentional and unintentional behavior... more The idea that prior intentions make the difference between intentional and unintentional behavior is simple and intuitive. At the same time, we lack an understanding of how voluntary actions actually come about, and the unquestioned appeal to intentions as discrete causes of actions offers little if anything in the way of an answer. We cite evidence suggesting that the origin of actions varies depending on context and effector, and argue that actions emerge from a causal web in the brain, rather than a central origin of intentional action. We will speculate on how our intuitions about forming an intention prior to acting might stem from the brain’s propensity to predict upcoming events. Finally we argue that the complex and dynamic origins of voluntary action and the interplay with predictions are better studied using a dynamical systems approach.

Research paper thumbnail of What do infants understand of others’ action? A theoretical account of early social cognition

Intention reading and action understanding have been reported in ever-younger infants. However, t... more Intention reading and action understanding have been reported in ever-younger infants. However, the notions of intention attribution and action understanding, as well as their relation to each other, are surrounded by much confusion, making it difficult to assess the meaning and value of such findings. In this paper we set out to clarify the notions of ‘action understanding’ and ‘intention attribution’, and discuss their relation. We will show that what is commonly referred to as ‘action understanding’ in fact encompasses various heterogeneous association and prediction mechanisms. In general, these forms of action understanding do not result in the attribution of an intention to an observed actor. By disentangling intention attribution from action understanding, and by exposing the latter as an umbrella notion, we provide a framework that allows for better comparison of findings from different experimental paradigms, and a much more fruitful approach to comparative questions.

Research paper thumbnail of Why we may not find intentions in the brain

Neuropsychologia 56, p.129-139, 2014

Intentions are commonly conceived of as discrete mental states that are the direct cause of actio... more Intentions are commonly conceived of as discrete mental states that are the direct cause of actions. In the last several decades, neuroscientists have taken up the project of localizing intentions in the brain, and a number of areas have been posited as implementing representations of intentions. We argue, however, that it is doubtful that the folk notion of ‘intention’ applies to any particular physical process by which the brain initiates actions. We will show that the idea of a discrete state that causes an action is deeply incompatible with the dynamic organization of the prefrontal cortex, the agreed upon neural locus of the causation and control of actions. Discrete representations can at best, we will claim, play a subsidiary, stabilizing role in action planning. This role, however, is still incompatible with the folk notion of intention. We conclude by arguing that the prevalence of the folk notion, including its intuitive appeal in neuroscientific explanations, stems from the central role intentions play in constructing intuitive explanations of our own and others’ behavior.

Research paper thumbnail of Hierarchies in Action and Motor Control

In analyses of the motor system, two hierarchies are often posited: The first – the action hierar... more In analyses of the motor system, two hierarchies are often posited: The first – the action hierarchy – is a decomposition of an action into sub-actions and sub-sub-actions. The second – the control hierarchy – is a postulated hierarchy in the neural control processes that are supposed to bring about the action. A general assumption in cognitive neuroscience is that these two hierarchies are internally consistent and provide complementary descriptions of neuronal control processes. In this essay, we suggest that neither offers a complete explanation and that they cannot be reconciled in a logical or conceptually coherent way. Furthermore, neither pays proper attention to the dynamics and temporal aspects of neural control processes. We will explore an alternative hierarchical organization in which causality is inherent in the dynamics over time. Specifically, high levels of the hierarchy encode more stable (goal-related) representations, while lower levels represent more transient (actions and motor acts) kinematics. If employed properly, a hierarchy based on this latter principle of temporal extension is not subject to the problems that plague the traditional accounts.

Research paper thumbnail of Understanding motor resonance

Social …, Jan 1, 2011

The discovery of mirror neurons in monkeys, and the finding of motor activity during action obser... more The discovery of mirror neurons in monkeys, and the finding of motor activity during action observation in humans are generally regarded to support motor theories of action understanding. These theories take motor resonance to be essential in the understanding of observed actions and the inference of action goals. However, the notions of “resonance,” “action understanding,” and “action goal” appear to be used ambiguously in the literature. A survey of the literature on mirror neurons and motor resonance yields two different interpretations of the term “resonance,” three different interpretations of action understanding, and again three different interpretations of what the goal of an action is. This entails that, unless it is specified what interpretation is used, the meaning of any statement about the relation between these concepts can differ to a great extent. By discussing an experiment we will show that more precise definitions and use of the concepts will allow for better assessments of motor theories of action understanding and hence a more fruitful scientific debate. Lastly, we will provide an example of how the discussed experimental setup could be adapted to test other interpretations of the concepts.

Research paper thumbnail of What do mirror neurons mirror?

Philosophical …, Jan 1, 2011

Single cell recordings in monkeys provide strong evidence for an important role of the motor syst... more Single cell recordings in monkeys provide strong evidence for an important role of the motor system in action understanding. This evidence is backed up by data from studies of the (human) mirror neuron system using neuroimaging or TMS techniques, and behavioral experiments. Although the data acquired from single cell recordings are generally considered to be robust, several debates have shown that the interpretation of these data is far from straightforward. We will show that research based on single-cell recordings allows for unlimited content attribution to mirror neurons. We will argue that a theoretical analysis of the mirroring process, combined with behavioral and brain studies, can provide the necessary limitations. A complexity analysis of the type of processing attributed to the mirror neuron system can help formulate restrictions on what mirroring is and what cognitive functions could, in principle, be explained by a mirror mechanism. We argue that processing at higher levels of abstraction needs assistance of non-mirroring processes to such an extent that subsuming the processes needed to infer goals from actions under the label ‘mirroring’ is not warranted.

Research paper thumbnail of When do we stop calling them mirror neurons?

Proceedings of the …, Jan 1, 1783

The discovery of mirror neurons in the 1990s has led to much excitement in the cognitive neurosci... more The discovery of mirror neurons in the 1990s has led to much excitement in the cognitive neurosciences. After the initial discovery more and more abilities have been attributed to these neurons. As mirror neurons are commonly viewed as vehicles of representation, we analyze the increasingly wider representational role mirror neurons play and argue for a principled distinction between mirror and non-mirror neurons.

Talks by Sebo Uithol

Research paper thumbnail of Social Cognition and its embodied roots

Research paper thumbnail of Engagement: Beyond mirroring, before mindreading

Research paper thumbnail of On the causal origins of intentional action

Research paper thumbnail of Sebo Uithol Curriculum Vitae

Research paper thumbnail of Embodying the camera: An EEG study on the effect of camera movements on film spectators´sensorimotorspectators´sensorimotor cortex activation

One key feature of film consists in its power to bodily engage the viewer. Previous research has ... more One key feature of film consists in its power to bodily engage the viewer. Previous research has suggested lens and camera movements to be among the most effective stylistic devices involved in such engagement. In an EEG experiment we assessed the role of such movements in modulating specific spectators´neuralspectators´neural and experiential responses, likely reflecting such engagement. We produced short video clips of an empty room with a still, a zooming and a moving camera (steadicam) that might simulate the movement of an observer in different ways. We found an event related desynchronization of the beta components of the rolandic mu rhythm that was stronger for the clips produced with steadicam than for those produced with a still or zooming camera. No equivalent modulation in the attention related occipital areas was found, thus confirming the sensorimotor nature of spectators´neuralspectators´neural responses to the film clips. The present study provides the first empirical evidence that filmic means such as camera movements alone can modulate spectators' bodily engagement with film.

Research paper thumbnail of Disentangling causal webs in the brain using functional magnetic resonance imaging: A review of current approaches

In the past two decades, functional Magnetic Resonance Imaging (fMRI) has been used to relate neu... more In the past two decades, functional Magnetic Resonance Imaging (fMRI) has been used to relate neuronal network activity to cognitive processing and behavior. Recently this approach has been augmented by algorithms that allow us to infer causal links between component populations of neuronal networks. Multiple inference procedures have been proposed to approach this research question but so far, each method has limitations when it comes to establishing whole-brain connectivity patterns. In this paper, we discuss eight ways to infer causality in fMRI research: Bayesian Nets, Dynamical Causal Modelling, Granger Causality, Likelihood Ratios, Linear Non-Gaussian Acyclic Models, Patel's Tau, Structural Equation Modelling, and Transfer Entropy. We finish with formulating some recommendations for the future directions in this area.

Research paper thumbnail of Reckoning the moment of reckoning in spontaneous voluntary movement

Proceedings of the National Academy of the Sciences, 2016

Research paper thumbnail of The Role of the Body in Social Cognition

WIREs Cognitive Science

In this review we discuss the actual and active dependence of social cognitive processes on the b... more In this review we discuss the actual and active dependence of social cognitive processes on the body, i.e. that part of the organism beyond the central nervous system. In particular, we will discuss mirror mechanisms, and assess the extent to which the body is recruited during these processes. We show that for emotion mirroring this dependency is well documented, but for action mirroring far less so. By reviewing these mechanisms and processes while contrasting body from brain, and social from general cognition, we show that both contrasts are arbitrary and problematic and that any study of cognitive processes, both social and general, should take the body into account.

Research paper thumbnail of Engagement: Looking beyond the mirror to understand action understanding

British Journal of Developmental Psychology

In this paper we argue that the current focus on mirroring as the route to explaining the develop... more In this paper we argue that the current focus on mirroring as the route to explaining the development of action understanding is misleading and problematic. It facilitates a fundamentally spectatorial stance, ignoring engagement and dialogue; it focuses on similarity between self and other and neglects difference; and it succumbs to the static terminology of mechanism rather than a dynamic language of process. Contrary to this view, dialogic exchanges are evident from the start of life, revealing the infants’ ability to engage with and respond appropriately to actions that are outside their own motor repertoire. We suggest that engagement rather than mirroring better accounts for many current findings in action understanding. The neurological evidence to date shows that action perception involves a process of continuous synchronisation and change, suggesting that it might be more fruitful for research and theory to look beyond mirroring and instead adopt dynamic processual explanations of action understanding within interaction.

Research paper thumbnail of Single-pulse transcranial magnetic stimulation reveals contribution of premotor cortex to object shape recognition

Brain Stimulation (in press)

Background It is known that ventral premotor cortex responds selectively to the visual perceptio... more Background
It is known that ventral premotor cortex responds selectively to the visual perception of object shapes. However, it is unclear whether this activation also contributes to visual processing.

Objective
In this study we want to assess whether activation in premotor areas contributes to visual perception of objects.

Methods
We measure performance on a perception task while delivering single pulse transcranial magnetic stimulation (TMS) to the left premotor cortex at different latencies after stimulus onset.

Results
We show that in cases of limited visual consciousness, disturbing the left premotor cortex 150 ms after stimulus onset results in a decrease in the capacity to recognize shapes, compared both to other latencies and to stimulation of the vertex.

Conclusion
Premotor cortex plays a constitutive role in object shape recognition.

Research paper thumbnail of Participation over observation: The roots of action understanding in attunement

Research paper thumbnail of No need to match: A comment on Bach, Nicholson and Hudson’s ‘Affordance-Matching Hypothesis’

Research paper thumbnail of How action selection can be embodied: intracranial gamma band recording shows response competition during the Eriksen flankers test

Frontiers in Human Neuroscience, Aug 26, 2014

Recent findings in monkeys suggest that action selection is based on a competition between variou... more Recent findings in monkeys suggest that action selection is based on a competition between various action options that are automatically planned by the motor system. Here we discuss data from intracranial EEG recordings in human premotor cortex during a bimanual version of the Eriksen flankers test that suggest that the same principles apply to human action decisions. Recording sites in the dorsal premotor cortex show an early but undifferentiated activation, a delayed response that depends on the experimental conditions and, finally, a movement related activation during action execution. Additionally, we found that the medial part of the premotor cortex show a significant increase in response for ipsilateral trials, suggesting a role in inhibiting the wrong response. The ventral premotor cortex seems to be involved in action execution, rather than action selection. Together these findings suggest that the human premotor cortex is part of a network that specifies, selects, and executes actions.

Research paper thumbnail of Nowhere and everywhere: the causal origin of voluntary action

The idea that prior intentions make the difference between intentional and unintentional behavior... more The idea that prior intentions make the difference between intentional and unintentional behavior is simple and intuitive. At the same time, we lack an understanding of how voluntary actions actually come about, and the unquestioned appeal to intentions as discrete causes of actions offers little if anything in the way of an answer. We cite evidence suggesting that the origin of actions varies depending on context and effector, and argue that actions emerge from a causal web in the brain, rather than a central origin of intentional action. We will speculate on how our intuitions about forming an intention prior to acting might stem from the brain’s propensity to predict upcoming events. Finally we argue that the complex and dynamic origins of voluntary action and the interplay with predictions are better studied using a dynamical systems approach.

Research paper thumbnail of What do infants understand of others’ action? A theoretical account of early social cognition

Intention reading and action understanding have been reported in ever-younger infants. However, t... more Intention reading and action understanding have been reported in ever-younger infants. However, the notions of intention attribution and action understanding, as well as their relation to each other, are surrounded by much confusion, making it difficult to assess the meaning and value of such findings. In this paper we set out to clarify the notions of ‘action understanding’ and ‘intention attribution’, and discuss their relation. We will show that what is commonly referred to as ‘action understanding’ in fact encompasses various heterogeneous association and prediction mechanisms. In general, these forms of action understanding do not result in the attribution of an intention to an observed actor. By disentangling intention attribution from action understanding, and by exposing the latter as an umbrella notion, we provide a framework that allows for better comparison of findings from different experimental paradigms, and a much more fruitful approach to comparative questions.

Research paper thumbnail of Why we may not find intentions in the brain

Neuropsychologia 56, p.129-139, 2014

Intentions are commonly conceived of as discrete mental states that are the direct cause of actio... more Intentions are commonly conceived of as discrete mental states that are the direct cause of actions. In the last several decades, neuroscientists have taken up the project of localizing intentions in the brain, and a number of areas have been posited as implementing representations of intentions. We argue, however, that it is doubtful that the folk notion of ‘intention’ applies to any particular physical process by which the brain initiates actions. We will show that the idea of a discrete state that causes an action is deeply incompatible with the dynamic organization of the prefrontal cortex, the agreed upon neural locus of the causation and control of actions. Discrete representations can at best, we will claim, play a subsidiary, stabilizing role in action planning. This role, however, is still incompatible with the folk notion of intention. We conclude by arguing that the prevalence of the folk notion, including its intuitive appeal in neuroscientific explanations, stems from the central role intentions play in constructing intuitive explanations of our own and others’ behavior.

Research paper thumbnail of Hierarchies in Action and Motor Control

In analyses of the motor system, two hierarchies are often posited: The first – the action hierar... more In analyses of the motor system, two hierarchies are often posited: The first – the action hierarchy – is a decomposition of an action into sub-actions and sub-sub-actions. The second – the control hierarchy – is a postulated hierarchy in the neural control processes that are supposed to bring about the action. A general assumption in cognitive neuroscience is that these two hierarchies are internally consistent and provide complementary descriptions of neuronal control processes. In this essay, we suggest that neither offers a complete explanation and that they cannot be reconciled in a logical or conceptually coherent way. Furthermore, neither pays proper attention to the dynamics and temporal aspects of neural control processes. We will explore an alternative hierarchical organization in which causality is inherent in the dynamics over time. Specifically, high levels of the hierarchy encode more stable (goal-related) representations, while lower levels represent more transient (actions and motor acts) kinematics. If employed properly, a hierarchy based on this latter principle of temporal extension is not subject to the problems that plague the traditional accounts.

Research paper thumbnail of Understanding motor resonance

Social …, Jan 1, 2011

The discovery of mirror neurons in monkeys, and the finding of motor activity during action obser... more The discovery of mirror neurons in monkeys, and the finding of motor activity during action observation in humans are generally regarded to support motor theories of action understanding. These theories take motor resonance to be essential in the understanding of observed actions and the inference of action goals. However, the notions of “resonance,” “action understanding,” and “action goal” appear to be used ambiguously in the literature. A survey of the literature on mirror neurons and motor resonance yields two different interpretations of the term “resonance,” three different interpretations of action understanding, and again three different interpretations of what the goal of an action is. This entails that, unless it is specified what interpretation is used, the meaning of any statement about the relation between these concepts can differ to a great extent. By discussing an experiment we will show that more precise definitions and use of the concepts will allow for better assessments of motor theories of action understanding and hence a more fruitful scientific debate. Lastly, we will provide an example of how the discussed experimental setup could be adapted to test other interpretations of the concepts.

Research paper thumbnail of What do mirror neurons mirror?

Philosophical …, Jan 1, 2011

Single cell recordings in monkeys provide strong evidence for an important role of the motor syst... more Single cell recordings in monkeys provide strong evidence for an important role of the motor system in action understanding. This evidence is backed up by data from studies of the (human) mirror neuron system using neuroimaging or TMS techniques, and behavioral experiments. Although the data acquired from single cell recordings are generally considered to be robust, several debates have shown that the interpretation of these data is far from straightforward. We will show that research based on single-cell recordings allows for unlimited content attribution to mirror neurons. We will argue that a theoretical analysis of the mirroring process, combined with behavioral and brain studies, can provide the necessary limitations. A complexity analysis of the type of processing attributed to the mirror neuron system can help formulate restrictions on what mirroring is and what cognitive functions could, in principle, be explained by a mirror mechanism. We argue that processing at higher levels of abstraction needs assistance of non-mirroring processes to such an extent that subsuming the processes needed to infer goals from actions under the label ‘mirroring’ is not warranted.

Research paper thumbnail of When do we stop calling them mirror neurons?

Proceedings of the …, Jan 1, 1783

The discovery of mirror neurons in the 1990s has led to much excitement in the cognitive neurosci... more The discovery of mirror neurons in the 1990s has led to much excitement in the cognitive neurosciences. After the initial discovery more and more abilities have been attributed to these neurons. As mirror neurons are commonly viewed as vehicles of representation, we analyze the increasingly wider representational role mirror neurons play and argue for a principled distinction between mirror and non-mirror neurons.

Research paper thumbnail of Social Cognition and its embodied roots

Research paper thumbnail of Engagement: Beyond mirroring, before mindreading

Research paper thumbnail of On the causal origins of intentional action

Research paper thumbnail of Action Control, Action Observation and their Embodied Roots

Research paper thumbnail of How to implement and avoid common sense: The case of intentional action

Control structures based on abstract action decisions, such as intentions, prove to be highly pro... more Control structures based on abstract action decisions, such as intentions, prove to be highly problematic, both on conceptual and empirical grounds, and many have argued that common sense cannot be implemented this way. I will discuss an alternative control structure in which these problems can be evaded. In this model action decisions are not made ‘in abstract’, but are the result of a competition between specified action options. Since these action options are implemented as sensorimotor processes, they are built around common sense knowledge of how to perform actions and what the sensorimotor consequences of those actions will be, which is implemented in the sensorimotor cortex. I will discuss recent evidence of our lab supporting this model. Finally, I will discuss research strategies that help to avoid using common sense concepts in neuroscientific investigation.

Research paper thumbnail of Options, not intentions: Towards a new neuroscience of intentional action

There is increasing evidence that the processes underlying action initiation and control are cons... more There is increasing evidence that the processes underlying action initiation and control are considerably more dynamic and context sensitive than the concept of intention can allow for. As a consequence, I argue, projects aimed at finding the neural implementation of intentions have produced diverse and highly puzzling findings. I will argue that actions do not stem from intentions, but from a competition between action options in the form of sensorimotor loops. I will present data supporting this view, and I will discuss the consequences of such a reinterpretation of intentional action for our conception of action understanding.

Research paper thumbnail of Intentions are explanations, not brain states

Intentions are commonly conceived of as discrete mental states that are the direct cause of actio... more Intentions are commonly conceived of as discrete mental states that are the direct cause of actions. In the last several decades, neuroscientists have taken up the project of finding the neural implementation of intentions, and a number of areas have been posited as implementing these states. I argue, however, that adopting the folk notion of ‘intention’ or one of its philosophical descendants in neuroscientific explanations can easily lead to a misinterpretation of the data, and can negatively influence investigation into the neural correlates of intentional action. In fact, I will argue that it is likely that intentions in this guise will never be found in the brain. As a consequence, the general idea of an action hierarchy has to be rethought thoroughly. In the final part of the talk I will zoom out, and discuss the relation between folk concepts and neuroscience, and the role philosophy might play in relating them.

Research paper thumbnail of Why Intentions cannot be found in the brain

Intentions are generally conceived as discrete mental states that cause appropriate actions. In t... more Intentions are generally conceived as discrete mental states that cause appropriate actions. In the last decade, a variety of attempts have been made to localize intentions in the brain, and several areas have been allocated as representing intentions. We argue, however, that it is doubtful that the notion of intention applies to any particular physical process by which the brain initiates actions. We will show that the idea of a discrete representation that causes an action is deeply incompatible with the dynamic organization of the prefrontal cortex, which is presumed to be the locus of causation and control of actions. Discrete representations can at best, we will claim, play a subsidiary, stabilizing role in action planning. This role, however, is still incompatible with the folk notion of intention. We conclude by arguing that prevalence of the folk view stems from the central role intentions play in explaining our own and others’ behavior.

Research paper thumbnail of Hierarchies in Action and Motor Control

In analyses of the motor system, two hierarchies are often posited : The first – the action hiera... more In analyses of the motor system, two hierarchies are often posited : The first – the action hierarchy –is a decomposition of an action into sub-actions and sub-sub-actions. The second – the control hierarchy – is a presumed hierarchy in the neural control processes that are supposed to bring the action about. A general assumption in cognitive (neuro)science is that these two hierarchies match. I will show, however, that two different structuring principles are used to construct the two hierarchies. The action hierarchy is constructed using a part-whole relation between the elements in the hierarchy, while the control hierarchy is structured around causal relations between the elements. I will argue that these two structuring principles are, however, incompatible, and that neither structure can account for both hierarchies. As a consequence, the action hierarchy and the control hierarchy need not, and probably will not, match entirely, suggesting that matching these to hierarchies might not be a viable strategy for empirical research. In addition, an alternative principle to structure a hierarchy can be derived from models in artificial intelligence: higher-level entities are represented more stably than lower-level entities. A hierarchy based on this principle is not subject to the problems that plague the traditional accounts.

Research paper thumbnail of Thesis: Representing Action and Intention

Uithol, S (2012) Representing Action and Intention, Radboud University Nijmegen, Nijmegen, the Netherlands , Oct 11, 2012

After introducing the notions of ‘representation’, ‘action’ and ‘intention’ in Chapter 1, in Chap... more After introducing the notions of ‘representation’, ‘action’ and ‘intention’ in Chapter 1, in Chapter 2 I investigate the process of content attribution to the firing of single mirror neurons. Single cell recordings in monkeys provide strong evidence for an important role of the motor system in action understanding, but although the data acquired from single cell recordings are generally considered to be robust, several debates have shown that the interpretation of these data is far from straightforward. Chapter 2 argues that, without principled restrictions, research based on single-cell recordings allows for unlimited content attribution to single mirror neurons. A theoretical analysis of the type of processing attributed to the mirror neuron system can help formulating restrictions on what mirroring is and what cognitive functions could, in principle, be explained by a mirror mechanism. It is argued that the processing at higher levels of abstraction needs assistance of non-mirroring processes to such an extent that subsuming the processes needed to infer goals from actions under the label ‘mirroring’ is not warranted.
In humans single cell recordings are problematic. Therefore, activation of the motor areas upon action observation using fMRI or EEG is studied. The finding of this so called ‘motor resonance’ is generally regarded to be supportive for motor theories of action understanding. These theories take motor resonance to be essential in the understanding of observed actions and the inference of action goals. However, Chapter 3 shows that the notions of ‘resonance’, ‘action understanding' and ‘action goal’ appear to be used ambiguously in the literature. A survey of the literature on mirror neurons and motor resonance yields two different interpretations of the term resonance, three different interpretations of action understanding, and again three different interpretations of what the goal of an action is. This entails that, unless it is specified what interpretation is used, the meaning of any statement about the relation between these concepts can differ to a great extent. By discussing Umilta et al.’s (2001) well-known experiment on mirror neurons I show that more precise definitions and use of the concepts will allow for better assessments of motor theories of action understanding and hence a more fruitful scientific debate. Lastly, I provide an example of how the discussed experimental setup could be adapted, based on the preceding analysis, to test other interpretations of the concepts.
Actions are commonly thought of as structured hierarchically. Chapter 4 analyses such hierarchies. In the literature two hierarchies are often posited: The first—the action hierarchy—is a decomposition of an action into sub-actions and sub-sub-actions. The second—the control hierarchy—is a postulated hierarchy in the neural control processes that are supposed to bring about the action. A general assumption in cognitive neuroscience is that these two hierarchies are internally consistent and provide complementary descriptions of neuronal control processes. In this chapter I show that that neither hierarchy offers a complete explanation and that they cannot be reconciled in a logical or conceptual way. Furthermore, neither pays proper attention to the dynamics and temporal aspects of neural control processes. I explore an alternative hierarchical organization in which causality is inherent in the dynamics over time. Specifically, high levels of the hierarchy encode slower (goal-related) representations, while lower levels represent faster (action and motor acts) kinematics. If employed properly, a hierarchy based on this principle is not subject to the problems that plague the traditional accounts.
Chapter 5 analyzes the neural applicability of the notion of ‘intention’. Intentions are commonly conceived of as discrete mental states that are the direct cause of actions. In the last several decades, neuroscientists have taken up the project of localizing intentions in the brain, and a number of areas have been posited as implementing representations of intentions. I argue, however, that it is doubtful that the folk notion of ‘intention’ applies to any particular physical process by which the brain initiates actions. Drawing on the analysis of Chapter 4, Pacherie’s account of intentions (Pacherie, 2006, 2008), and Koechlin’s model on action control (Koechlin et al, 1999, 2003) I show that the idea of a discrete state that causes an action is deeply incompatible with the dynamic organization of the prefrontal cortex, the presumed neural locus of the causation and control of actions. Discrete representations can at best, I will claim, play a subsidiary, stabilizing role in action planning, but this role is still incompatible with the folk notion of intention. This chapter concludes by arguing that the prevalence of the folk notion, including its intuitive appeal in neuroscientific explanations, stems from the central role intentions play in constructing intuitive explanations of our own and others’ behavior. Some future directions based on the presented analysis are sketched below.
Finally, in Chapter 6 the ideas, results, and analyses of the previous chapters are applied to the field of developmental psychology. Intention reading and action understanding have been reported in ever-younger infants, but these findings are highly debated. In this chapter I set out to clarify the notions of ‘action understanding’ and ‘intention attribution’ and discuss their relation. I use the various forms of ‘action understanding’ from Chapter 3 and speculate on the mechanisms that could underlie these capacities. Based on Chapter 5 I argue that these forms of action understanding do not generally result in the attribution of an intention to an observed actor. By disentangling intention attribution from action understanding, and by exposing the latter as an umbrella notion, I provide a framework that allows for better comparing findings from different experimental paradigms.

Research paper thumbnail of The Effect of Context on the Neural Correlates of Intentions

SSRN Electronic Journal

Many studies have identified networks in parietal and prefrontal cortex that are involved in inte... more Many studies have identified networks in parietal and prefrontal cortex that are involved in intentional action. Yet, our understanding of the way these networks are involved in intentions is still very limited. In this study, we investigate two characteristics of these processes: context- and reason-dependence of the neural states associated with intentions. We ask whether these states depend on the context a person is in and the reasons they have for choosing an action. We used a combination of functional magnetic resonance imaging (fMRI) and multivariate decoding to directly assess the context- and reason-dependency of the neural states underlying intentions. We show that action intentions can be decoded from fMRI data based on a classifier trained in the same context and with the same reason, in line with previous decoding studies. Furthermore, we found that intentions can be decoded across different reasons for choosing an action. However, decoding across different contexts was not successful. We found anecdotal to moderate evidence against context-invariant information in all regions of interest and for all conditions but one. These results suggest that the neural states associated with intentions are modulated by the context of the action.

Research paper thumbnail of Single-pulse Transcranial Magnetic Stimulation Reveals Contribution of Premotor Cortex to Object Shape Recognition

Brain Stimulation, Sep 1, 2015

Background: Single pulse transcranial magnetic stimulation (sTMS) is a novel treatment for acute ... more Background: Single pulse transcranial magnetic stimulation (sTMS) is a novel treatment for acute migraine. Previous randomised controlled data demonstrated that sTMS is effective and well tolerated in the treatment of migraine with aura. The aim of the programme reported here was to evaluate patient responses in the setting of routine clinical practice. Methods: Migraine patients with and without aura treating with sTMS had an initial review (n = 426) and training call, and then participated in telephone surveys at week six (n = 331) and week 12 during a 3-month treatment period (n = 190). Results: Of patients surveyed with 3 month data (n = 190; episodic, n = 59; chronic, n = 131), 62 % reported pain relief, finding the device effective at reducing or alleviating migraine pain; in addition there was relief reported of associated features: nausea-52 %; photophobia-55 %; and phonophobia-53 %. At 3 months there was a reduction in monthly headache days for episodic migraine, from 12 (median, 8-13 IQ range) to 9 (4-12) and for chronic migraine, a reduction from 24 (median, 16-30 IQ range) to 16 (10-30). There were no serious or unanticipated adverse events. Conclusion: sTMS may be a valuable addition to options for the treatment of both episodic and chronic migraine.

Research paper thumbnail of The effect of context and reason on the neural correlates of intentions

Research paper thumbnail of Causal inference in functional Magnetic Resonance Imaging

In the past two decades, functional Magnetic Resonance Imaging has been used to relate neuronal n... more In the past two decades, functional Magnetic Resonance Imaging has been used to relate neuronal network activity to cognitive processing and behaviour. Recently this approach has been augmented by algorithms that allow us to infer causal links between component populations of neuronal networks. Multiple inference procedures have been proposed to approach this research question but so far, each method has limitations when it comes to establishing whole-brain connectivity patterns. In this paper, we discuss the ways to infer causality in fMRI research. We also formulate recommendations for the future directions in this area. 1 What is causality? Although inferring causal relations is a fundamental aspect of scientific research, the notion of causation itself can be notoriously difficult to define. The basic idea is straightforward: When process A is the cause of process B, A is necessarily in the past from B, and without A, B would not occur. But in practice, and in dynamic systems su...

Research paper thumbnail of Causal inference in functional Magnetic Resonance Imaging: a Review of current approaches

In the past two decades, functional Magnetic Resonance Imaging has been used to relate neuronal n... more In the past two decades, functional Magnetic Resonance Imaging has been used to relate neuronal network activity to cognitive processing and behaviour. Recently this approach has been augmented by algorithms that allow us to infer causal links between component populations of neuronal networks. Multiple inference procedures have been proposed to approach this research question but so far, each method has limitations when it comes to establishing whole-brain connectivity patterns. In this paper, we discuss the ways to infer causality in fMRI research. We also formulate recommendations for the future directions in this area. 1 What is causality? Although inferring causal relations is a fundamental aspect of scientific research, the notion of causation itself can be notoriously difficult to define. The basic idea is straightforward: When process A is the cause of process B, A is necessarily in the past from B, and without A, B would not occur. But in practice, and in dynamic systems such as the brain in particular, the picture is far less clear. First, for any event a large number of (potential) causes can be identified. The efficacy of certain neuronal process in producing behavior is dependent on the state of many other (neuronal) processes, but also on the availability of glucose and oxygen in the brain, etc. In a neuroscientific context, we are generally not interested in most of these causes, but only in a cause that stands out in such a way that it is deemed to provide a substantial part of the explanation, for instance causes that vary with the experimental conditions. However, the contrast between relevant and irrelevant causes (in terms of explanatory power) is arbitrary and strongly dependent on experimental setup, contextual factors, etc. For instance, respiratory movement is typically considered a confound in fMRI experiments, unless the research question concerns the influence of respiration speed on the dynamics of the neuronal networks. In dynamic systems, causal processes are unlikely to be part of a unidirectional chain of events, but rather a causal web, with often mutual influences between process A and B. As a result, it is hard to maintain the temporal ordering of cause and effect and, indeed, a clear separation between them [119]. Furthermore, causation can never be established directly, just correlation [61]. When a correlation is highly stable, we are inclined to infer a causal link. Additional information is then needed to assess the direction of the assumed causal link, as correlation indicates 1 ar X iv :1 70 8. 04 02 0v 1 [ qbi o. Q M ] 1 4 A ug 2 01 7 for association and not for causation [1]. For example, the motor cortex is always active when a movement is made, so we assume a causal link between the two phenomena. The anatomical and physiological properties of the motor cortex, and the timing of the two phenomena provide clues about the direction of causality (i.e. cortical activity causes the movement, and not the other way around). However, only intervention studies, such as delivering Transcranial Magnetic Simulation (TMS, [75]) pulses over the motor cortex or lesion studies, can confirm the causal link between the activity in the motor cortex and behavior. Causal studies in fMRI are based on three types of correlations: correlating neuronal activity to 1) mental and behavioral phenomena; 2) physiological state (such as neurotransmitters, hormones, etc.), and 3) neuronal activity in other parts of the brain. In this review we will focus on the last field of research: establishing causal connections between two or more brain areas. fMRI studies currently use a variety of algorithms to infer causal links [35, 131]. All these methods have different assumptions, advantages and disadvantages (see for instance [141, 136]). In a seminal study by Smith et al., popular approaches to causal processes were compared using synthetic data created with a Dynamic Causal Modeling (DCM, see below) generative model [42]. Surprisingly, most of the methods struggled to perform above chance level, even though the test networks were sparse and the noise levels introduced to the model were low compared to what one would expect in real recordings. This raises the question: given the characteristics of fMRI data (low temporal resolution, slow haemodynamics, low signal-to-noise ratio; see Section 2) and the fact that causal webs in the brain are likely dense and dynamic, is it in principle possible to investigate causality in the brain using MRI? In this review, we discuss this question. First, we identify seven characteristics of models used to study causality. Then, we compare and contrast the popular approaches to the causal research in fMRI according to these criteria. Our list of features of causality is as follows: 1. Sign of connections: Can the algorithm distinguish between excitatory and inhibitory causal relations? In this context, we do not mean synaptic effects, but rather an overall…

Research paper thumbnail of Waarom we hersenen hebben

Item does not contain fulltext4 p

Research paper thumbnail of The Anticipatory and Task-Driven Nature of Visual Perception

Cerebral Cortex, 2021

Humans have a remarkable capacity to arrange and rearrange perceptual input according to differen... more Humans have a remarkable capacity to arrange and rearrange perceptual input according to different categorizations. This begs the question whether the categorization is exclusively a higher visual or amodal process, or whether categorization processes influence early visual areas as well. To investigate this we scanned healthy participants in a magnetic resonance imaging scanner during a conceptual decision task in which participants had to answer questions about upcoming images of animals. Early visual cortices (V1 and V2) contained information about the current visual input, about the granularity of the forthcoming categorical decision, as well as perceptual expectations about the upcoming visual stimulus. The middle temporal gyrus, the anterior temporal lobe, and the inferior frontal gyrus were also involved in the categorization process, constituting an attention and control network that modulates perceptual processing. These findings provide further evidence that early visual p...

Research paper thumbnail of Representaties in cognitieve neurowetenschap

Algemeen Nederlands Tijdschrift voor Wijsbegeerte, 2019

Representations in cognitive neuroscienceExplanations in terms of representations are ubiquitous ... more Representations in cognitive neuroscienceExplanations in terms of representations are ubiquitous in cognitive neuroscience. In this paper I will show that the question of who is using the representation is of crucial importance, but not often explicitly answered. Two possible users, the scientist and the cognitive system are theoretically strictly distinct, but the distinction is in practice often blurred. It is tempting to jump from ‘representations to the scientist’ to ‘representations to the system’. This step, however, is unwarranted. I will show that representations to the scientist are not in themselves problematic, and can even be useful, but can lead to wrong conclusions. The problems with representations for the system are more fundamental.

Research paper thumbnail of The context-dependent nature of the neural implementation of intentions

Many studies have identified networks in parietal and prefrontal cortex that are involved in inte... more Many studies have identified networks in parietal and prefrontal cortex that are involved in intentional action. Yet, knowledge about what these networks exactly encoded is still scarce. In this study we look into the content of those processes. We ask whether the neural representations of intentions are context- and reason-invariant, or whether these processes depend on the context we are in, and the reasons we have for choosing an action. We use a combination of functional magnetic resonance imaging and multivariate decoding to directly assess the context- and reason-dependency of the processes underlying intentional action. We were able to decode action decisions in the same context and for the same reasons from the fMRI data, in line with previous decoding studies. Furthermore, we could decode action decisions across different reasons for choosing an action. Importantly, though, decoding decisions across different contexts was at chance level. These results suggest that for volu...

Research paper thumbnail of Embodying the camera: An EEG study on the effect of camera movements on film spectators´ sensorimotor cortex activation

Research paper thumbnail of Disentangling casual webs in the brain using functional magnetic resonance imaging: A review of current approaches

Network Neuroscience, 2018

In the past two decades, functional Magnetic Resonance Imaging (fMRI) has been used to relate neu... more In the past two decades, functional Magnetic Resonance Imaging (fMRI) has been used to relate neuronal network activity to cognitive processing and behavior. Recently this approach has been augmented by algorithms that allow us to infer causal links between component populations of neuronal networks. Multiple inference procedures have been proposed to approach this research question but so far, each method has limitations when it comes to establishing whole-brain connectivity patterns. In this paper, we discuss eight ways to infer causality in fMRI research: Bayesian Nets, Dynamical Causal Modelling, Granger Causality, Likelihood Ratios, Linear Non-Gaussian Acyclic Models, Patel’s Tau, Structural Equation Modelling, and Transfer Entropy. We finish with formulating some recommendations for the future directions in this area.

Research paper thumbnail of Participation Over Observation: The Roots of Action Understanding in Attunement: Comment on Reddy's 'Joining Intentions in Infancy

Journal of Consciousness Studies, 2015

Research paper thumbnail of Reckoning the moment of reckoning in spontaneous voluntary movement

Proceedings of the National Academy of Sciences, 2016

Research paper thumbnail of Engagement: Looking beyond the mirror to understand action understanding

British Journal of Developmental Psychology, 2015

Research paper thumbnail of The role of the body in social cognition. WIREs Cogn Sci 2015. doi: 10.1002/wcs.1357

Wiley interdisciplinary reviews. Cognitive science

In this review, we discuss the actual and active dependence of social cognitive processes on the ... more In this review, we discuss the actual and active dependence of social cognitive processes on the body, i.e., that part of the organism beyond the central nervous system. In particular, we will discuss mirror mechanisms, and assess the extent to which the body is recruited during these processes. We show that for emotion mirroring, this dependency is well-documented, but for action mirroring far less so. By reviewing these mechanisms and processes while contrasting body from brain, and social from general cognition, we show that both contrasts are arbitrary and problematic and that any study of cognitive processes, both social and general, should take the body into account.

Research paper thumbnail of The role of the body in social cognition

Wiley interdisciplinary reviews. Cognitive science, 2015

In this review, we discuss the actual and active dependence of social cognitive processes on the ... more In this review, we discuss the actual and active dependence of social cognitive processes on the body, i.e., that part of the organism beyond the central nervous system. In particular, we will discuss mirror mechanisms, and assess the extent to which the body is recruited during these processes. We show that for emotion mirroring, this dependency is well-documented, but for action mirroring far less so. By reviewing these mechanisms and processes while contrasting body from brain, and social from general cognition, we show that both contrasts are arbitrary and problematic and that any study of cognitive processes, both social and general, should take the body into account. WIREs Cogn Sci 2015, 6:453-460. doi: 10.1002/wcs.1357 For further resources related to this article, please visit the WIREs website.

Research paper thumbnail of UitholMirrorNeuronsPhilPsy2011

Research paper thumbnail of No need to match: a comment on Bach, Nicholson and Hudson's “Affordance-Matching Hypothesis”

Frontiers in Human Neuroscience, 2014

Research paper thumbnail of What do infants understand of others’ action? A theoretical account of early social cognition

Psychological Research, 2013

Intention reading and action understanding have been reported in ever-younger infants. However, t... more Intention reading and action understanding have been reported in ever-younger infants. However, the notions of intention attribution and action understanding, as well as their relation to each other, are surrounded by much confusion, making it difficult to assess the meaning and value of such findings. In this paper we set out to clarify the notions of 'action understanding' and 'intention attribution'. We will show that what is commonly referred to as 'action understanding' in fact encompasses various heterogeneous association and prediction mechanisms. In general, these forms of action understanding will not result in the attribution of an intention to an observed actor. By detaching intention attribution from action understanding, and by exposing the latter as an umbrella notion, we provide a theoretical framework on early social cognition that allows for better comparison of findings from different experimental paradigms, and better assessment of infant action understanding abilities. Taking into account the plurality of forms that action understanding can adopt will help cognitive neuroscience to gain a full understanding of the early roots of social cognition.

Research paper thumbnail of Nowhere and Everywhere: The Causal Origin of Voluntary Action

Review of Philosophy and Psychology, 2015

Research paper thumbnail of Uithol,Görgen,Pischedda,Toni&Haynes

BioRxiv, 2018

Many studies have identified networks in parietal and prefrontal cortex that are involved in inte... more Many studies have identified networks in parietal and prefrontal cortex that are involved in intentional action. Yet, knowledge about what these networks exactly encoded is still scarce. In this study we look into the content of those processes. We ask whether the neural representations of intentions are context- and reason-invariant, or whether these processes depend on the context we are in, and the reasons we have for choosing an action. We use a combination of functional magnetic resonance imaging and multivariate decoding to directly assess the context- and reason dependency of the processes underlying intentional action. We were able to decode action decisions in the same context and for the same reasons from the fMRI data, in line with previous decoding studies. Furthermore, we could decode action decisions across different reasons for choosing an action. Importantly, though, decoding decisions across different contexts was at chance level. These results suggest that for voluntary action,
there is considerable context-dependency in intention representations. This suggests that established invariance in neural processes may not reflect an essential feature of a certain process, but that this stable character could be dependent on invariance in the experimental setup, in line with predictions from situated cognition theory.