Reward Processing in Schizophrenia: A Deficit in the Representation of Value (original) (raw)
Related papers
A Review of Reward Processing and Motivational Impairment in Schizophrenia
Schizophrenia Bulletin
This article reviews and synthesizes research on reward processing in schizophrenia, which has begun to provide important insights into the cognitive and neural mechanisms associated with motivational impairments. Aberrant cortical-striatal interactions may be involved with multiple reward processing abnormalities, including: (1) dopamine-mediated basal ganglia systems that support reinforcement learning and the ability to predict cues that lead to rewarding outcomes; (2) orbitofrontal cortex-driven deficits in generating, updating, and maintaining value representations; (3) aberrant effort-value computations, which may be mediated by disrupted anterior cingulate cortex and midbrain dopamine functioning; and (4) altered activation of the prefrontal cortex, which is important for generating exploratory behaviors in environments where reward outcomes are uncertain. It will be important for psychosocial interventions targeting negative symptoms to account for abnormalities in each of t...
Reward-driven decision-making impairments in schizophrenia
Schizophrenia Research, 2018
The ability to use feedback to guide optimal decision-making is essential for goal-directed behaviour. While impairments in feedback-driven decision-making have been associated with schizophrenia and depression, this has been examined primarily in the context of binary probabilistic choice paradigms. In real-world decision-making, however, individuals must make choices when there are more than two competing options that vary in the frequency and magnitude of potential rewards and losses. Thus, the current study examined win-stay/lose-shift (WSLS) behaviour on the Iowa Gambling Task (IGT) in order to evaluate the influence of immediate rewards and losses in guiding real-world decision-making in patients with schizophrenia and major depressive disorder. Fifty-one patients with schizophrenia, 43 patients with major depressive disorder, and 51 healthy controls completed the IGT, as well as a series of clinical and cognitive measures. WSLS was assessed by quantifying trial-bytrial behaviour following rewards and losses on the IGT. Multivariate analyses of variance revealed that patients with schizophrenia demonstrated intact lose-shift behaviour, but significantly reduced win-stay rates compared to healthy controls. In contrast, no WSLS impairments emerged in the depressed group. Win-stay impairments in the schizophrenia group were significantly related to deficits in motivation and cognition. Patients with schizophrenia exhibit impaired reward-driven decision-making in the context of multiple choices with concurrent rewards and losses, and this appears to be driven by a reduced propensity for advantageous win-stay behaviour. With the importance of reward learning and decision-making in generating goal-directed behaviour, these findings suggest a potential mechanism contributing to the motivation deficits seen in schizophrenia.
Decision-Making Impairments in the Context of Intact Reward Sensitivity in Schizophrenia
Biological Psychiatry, 2008
BACKGROUND: Deficits in motivated behavior and decision-making figure prominently in the behavioral syndrome that characterizes schizophrenia and are difficult both to treat and to understand. One explanation for these deficits is that schizophrenia decreases sensitivity to rewards in the environment. An alternate explanation is that sensitivity to rewards is intact but that poor integration of affective with cognitive information impairs the ability to use this information to guide behavior.
NeuroImage, 2010
In patients with schizophrenia, the ability to learn from reinforcement is known to be impaired. The present fMRI study aimed at investigating the neural correlates of reinforcement-related trial-and-error learning in 19 schizophrenia patients and 20 healthy volunteers. A modified gambling paradigm was applied where each cue indicated a subsequent number which had to be guessed. In order to vary predictability, the cuenumber associations were based on different probabilities (50%, 81%, 100%) which the participants were not informed about. Patients' ability to learn contingencies on the basis of feedback and reward was significantly impaired. While in healthy volunteers increasing predictability was associated with decreasing activation in a fronto-parietal network, this decrease was not detectable in patients. Analysis of expectancy-related reinforcement processing yielded a hypoactivation in putamen, dorsal cingulate and superior frontal cortex in patients relative to controls. Present results indicate that both reinforcement-associated processing and reinforcement learning might be impaired in the context of the disorder. They moreover suggest that the activation deficits which patients exhibit in association with the processing of reinforcement might constitute the basis for the learning deficits and their accompanying activation alterations.
Reward-related decision-making in schizophrenia: A multimodal neuroimaging study
Psychiatry Research: Neuroimaging, 2019
Schizophrenia is a severe psychiatric disorder characterized by important cognitive deficits, which ultimately compromise the patients' ability to make optimal decisions. Unfortunately, the neurobiological bases of impaired reward-related decision-making in schizophrenia have rarely been studied. The objective of this study is to examine the neural mechanisms involved in reward-related decision-making in schizophrenia, using functional magnetic resonance imaging (fMRI). Forty-seven schizophrenia patients (DSM-IV criteria) and 23 healthy subjects with no psychiatric disorders were scanned using fMRI while performing the Balloon Analogue Risk Task (BART). A rapid event-related fMRI paradigm was used, separating decision and outcome events. Between-group differences in grey matter volumes were assessed with voxel-based morphometry. During the reward outcomes, increased activations were observed in schizophrenia in the left anterior insula, the putamen, and frontal sub-regions. Reduced grey matter volumes were observed in the left anterior insula in schizophrenia which spatially overlapped with functional alterations. Finally, schizophrenia patients made fewer gains on the BART. The fact that schizophrenia patients had increased activations in sub-cortical regions such as the striatum and insula in response to reward events suggests that the impaired decisionmaking abilities of these patients are mostly driven by an overvaluation of outcome stimuli.
Biological Psychiatry: Cognitive Neuroscience and Neuroimaging, 2017
BACKGROUND: The current study was designed to test the hypothesis that motivational deficits in schizophrenia (SZ) are tied to a reduced ability to differentially signal gains and instances of loss-avoidance in the brain, leading to reduced ability to form adaptive representations of expected value. METHODS: We administered a reinforcement learning paradigm to 27 medicated SZ patients and 27 control subjects in which participants learned three probabilistic discriminations. In regions of interest in reward networks identified a priori, we examined contrasts between trial types with different expected values (e.g., expected gain-nonmonetary) and between outcomes with the same prediction error valence but different experienced values (e.g., gain-lossavoidance outcome, miss-loss outcome). RESULTS: Both whole-brain and region of interest analyses revealed that SZ patients showed reduced differentiation between gain and loss-avoidance outcomes in the dorsal anterior cingulate cortex and bilateral anterior insula. That is, SZ patients showed reduced contrasts between positive prediction errors of different objective values in these areas. In addition, we observed significant correlations between gain-loss-avoidance outcome contrasts in the ventral striatum and ratings for avolition/anhedonia and between expected gain-nonmonetary contrasts in the ventral striatum and ventromedial prefrontal cortex. CONCLUSIONS: These results provide further evidence for intact prediction error signaling in medicated SZ patients, especially with regard to loss-avoidance. By contrast, components of frontostriatal circuits appear to show reduced sensitivity to the absolute valence of expected and experienced outcomes, suggesting a mechanism by which motivational deficits may emerge.
Biological Psychiatry: Cognitive Neuroscience and Neuroimaging, 2018
BACKGROUND: The current study was designed to test the hypothesis that motivational deficits in schizophrenia (SZ) are tied to a reduced ability to differentially signal gains and instances of loss-avoidance in the brain, leading to reduced ability to form adaptive representations of expected value. METHODS: We administered a reinforcement learning paradigm to 27 medicated SZ patients and 27 control subjects in which participants learned three probabilistic discriminations. In regions of interest in reward networks identified a priori, we examined contrasts between trial types with different expected values (e.g., expected gain–nonmonetary) and between outcomes with the same prediction error valence but different experienced values (e.g., gain–loss- avoidance outcome, miss–loss outcome). RESULTS: Both whole-brain and region of interest analyses revealed that SZ patients showed reduced differentiation between gain and loss-avoidance outcomes in the dorsal anterior cingulate cortex and bilateral anterior insula. That is, SZ patients showed reduced contrasts between positive prediction errors of different objective values in these areas. In addition, we observed significant correlations between gain–loss-avoidance outcome contrasts in the ventral striatum and ratings for avolition/anhedonia and between expected gain–nonmonetary contrasts in the ventral striatum and ventromedial prefrontal cortex. CONCLUSIONS: These results provide further evidence for intact prediction error signaling in medicated SZ patients, especially with regard to loss-avoidance. By contrast, components of frontostriatal circuits appear to show reduced sensitivity to the absolute valence of expected and experienced outcomes, suggesting a mechanism by which motivational deficits may emerge.
Neuropsychology of reward learning and negative symptoms in schizophrenia
Schizophrenia Research, 2014
We used the Iowa Gambling Test (IGT) to examine the relationship of reward learning to both neuropsychological functioning and symptom formation in 65 individuals with schizophrenia. Results indicated that compared to controls, participants with schizophrenia showed significantly reduced reward learning, which in turn correlated with reduced intelligence, memory and executive function, and negative symptoms. The current findings suggested that a disease-related disturbance in reward learning may underlie both cognitive and motivation deficits, as expressed by neuropsychological impairment and negative symptoms in schizophrenia.
Biological Psychiatry: Cognitive Neuroscience and Neuroimaging, 2021
Background:The current study aimed to further etiological understanding of the psychological mechanisms underlying negative symptoms in people with schizophrenia. Specifically, we tested whether negative symptom severity is associated with reduced retention of reward-related information over time, and thus a degraded ability to utilize such information to guide future action selection.Methods:44 patients with a diagnosis of schizophrenia or schizoaffective disorder and 28 healthy volunteers performed a probabilistic reinforcement-learning task involving stimulus pairs in which choices resulted in reward or in loss avoidance. Following training, participants indicated their valuation of learned stimuli in a test/transfer phase. The test/transfer phase was administered immediately following training and one-week later. Percent retention was defined as accuracy at weeklong delay divided by accuracy at immediate delay.Results:Both healthy controls and people with schizophrenia showed similarly robust retention of reinforcement learning over a one-week delay interval. However, in the schizophrenia group, negative symptom severity was associated with reduced retention of information regarding the value of actions across a weeklong interval. This pattern was particularly notable for stimuli associated with reward compared to loss avoidance.Conclusions:Our results show that, although individuals with schizophrenia may initially learn about rewarding aspects of their environment, such learning decays at a more rapid rate in patients with severe negative symptoms. Thus, previously learned reward-related information may be more difficult to access to guide future decision-making and to motivate action selection.
Biological Psychiatry: Cognitive Neuroscience and Neuroimaging, 2019
BACKGROUND: Motivational deficits in people with schizophrenia (PSZ) are associated with an inability to integrate the magnitude and probability of previous outcomes. The mechanisms that underlie probability-magnitude integration deficits, however, are poorly understood. We hypothesized that increased reliance on "valueless" stimulus-response associations, in lieu of expected value (EV)-based learning, could drive probability-magnitude integration deficits in PSZ with motivational deficits. METHODS: Healthy volunteers (n = 38) and PSZ (n = 49) completed a learning paradigm consisting of four stimulus pairs. Reward magnitude (3, 2, 1, 0 points) and probability (90%, 80%, 20%, 10%) determined each stimulus's EV. Following a learning phase, new and familiar stimulus pairings were presented. Participants were asked to select stimuli with the highest reward value. RESULTS: PSZ with high motivational deficits made increasingly less optimal choices as the difference in reward value (probability 3 magnitude) between two competing stimuli increased. Using a previously validated computational hybrid model, PSZ relied less on EV ("Q-learning") and more on stimulus-response learning ("actor-critic"), which correlated with Scale for the Assessment of Negative Symptoms motivational deficit severity. PSZ specifically failed to represent reward magnitude, consistent with model demonstrations showing that response tendencies in the actor-critic were preferentially driven by reward probability. CONCLUSIONS: Probability-magnitude deficits in PSZ with motivational deficits arise from underutilization of EV in favor of reliance on valueless stimulus-response associations. Confirmed by our computational hybrid framework, probability-magnitude integration deficits were driven specifically by a failure to represent reward magnitude. This work provides a first mechanistic explanation of complex EV-based learning deficits in PSZ with motivational deficits that arise from an inability to combine information from different reward modalities. Many people with schizophrenia (PSZ) suffer from a reduced tendency to engage in goal-directed behavior (1,2), termed amotivation or avolition. These deficits in motivation can contribute substantially to poor functional capacity and quality of life (3-5). One explanation suggests that motivational deficits result from a specific impairment in the ability to precisely represent the value of an action or choice (expected value [EV]) coupled with overreliance on "valueless" stimulus-response associations (6-8). Support for this computational account, however, comes from studies using reinforcement learning (RL) paradigms in which reward probability (the chance of obtaining a reward) solely determines EV. Importantly, other evidence indicates that EV estimation deficits in PSZ (with motivational deficits) are most prominent when EV depends on the successful integration of reward magnitude (size) and probability. One important line of evidence suggesting prominent deficits in EV representation comes from the Iowa Gambling Task (9), in which participants select from four card decks with varying reward magnitude and probability. Performance deficits on this task, in PSZ, are driven by a reduced ability to integrate long-term outcome magnitude and probability (10-12). These deficits extend to contexts in which participants choose between earning a small certain reward or gamble for a larger reward (a "framing" task) (13). When reward magnitude and probability vary continuously, impaired EV computations in PSZ with motivational deficits are primarily driven by decreased sensitivity to reward magnitude (14). In contrast, 280