Cromwell Relative Reward Striatal Activity.pdf (original) (raw)
Related papers
Striatal Activity and Reward Relativity: Neural Signals Encoding Dynamic Outcome Valuation
eNeuro
The striatum is a key brain region involved in reward processing. Striatal activity has been linked to encoding reward magnitude and integrating diverse reward outcome information. Recent work has supported the involvement of striatum in the valuation of outcomes. The present work extends this idea by examining striatal activity during dynamic shifts in value that include different levels and directions of magnitude disparity. A novel task was used to produce diverse relative reward effects on a chain of instrumental action. Rats (Rattus norvegicus) were trained to respond to cues associated with specific outcomes varying by food pellet magnitude. Animals were exposed to single-outcome sessions followed by mixed-outcome sessions, and neural activity was compared among identical outcome trials from the different behavioral contexts. Results recording striatal activity show that neural responses to different task elements reflect incentive contrast as well as other relative effects that involve generalization between outcomes or possible influences of outcome variety. The activity that was most prevalent was linked to food consumption and post-food consumption periods. Relative encoding was sensitive to magnitude disparity. A within-session analysis showed strong contrast effects that were dependent upon the outcome received in the immediately preceding trial. Significantly higher numbers of responses were found in ventral striatum linked to relative outcome effects. Our results support the idea that relative value can incorporate diverse relationships, including comparisons from specific individual outcomes to general behavioral contexts. The striatum contains these diverse relative processes, possibly enabling both a higher information yield concerning value shifts and a greater behavioral flexibility.
Relative reward processing in primate striatum
Experimental Brain Research, 2005
Rewards are often not only valued according to their physical characteristics but also relative to other available rewards. The striatum (caudate nucleus, putamen, ventral striatum including nucleus accumbens) is involved in the organization of movement and the processing of reward information. We studied the activity of single striatal neurons in macaques that were presented with different combinations of two rewards. We found in nearly half of the investigated neurons that the processing for one reward shifted, relative to the other rewards that were available in a given trial block. The relative reward processing concerned all forms of striatal activity related to reward-predicting visual stimuli, arm movements and reception of rewards. The observed changes may provide a neural basis for the known shifts in valuation of rewarding outcomes relative to known references.
Effects of Expectations for Different Reward Magnitudes on Neuronal Activity in Primate Striatum
Journal of Neurophysiology, 2003
Caudate Nucleus [PDF] [Full Text] [Abstract] , April , 2014; 21 (4): 223-231. Learn. Mem. accumbens shell during specific time segments Behavioral flexibility is increased by optogenetic inhibition of neurons in the nucleus [PDF] [Full Text] [Abstract] , June , 2014; 9 (6): 864-872. Soc Cogn Affect Neurosci Neural correlates of effective and ineffective mood induction [PDF] [Full Text] [Abstract] 2014; 83 (12): 1112-1118. Neurology Fabienne Picard and Karl Friston Predictions, perception, and a sense of self [PDF] [Full Text] [Abstract] , October 15, 2014; 34 (42): 14147-14162. Downloaded from duces aphagia and exaggerated treading following striatopallidal lesions in the rat. Behav Neurosci 104: 778 -795, 1990. Black RW. Shifts in magnitude of reward and contrast effects in instrumental and selective learning: a reinterpretation. Psych Rev 75: 114 -126, 1968. Bloomfield TM. Behavioral contrast and relative reinforcement frequency in two multiple schedules. J Exp Anal Behav 10: 151-158, 1967. Blough PM. Overall and local contrast in multiple schedules: effects of stimulus similarity and discrimination performance. Anim Learn Behav 16: 395-403, 1988. Boussaoud D. Attention versus intention in the primate premotor cortex. Neuroimage 14: S40 -S45, 2001. Boussaoud D, di Pellegrino G, and Wise SP. Frontal lobe mechanisms subserving vision for action versus vision for perception. Behav Brain Res 72: 1-15, 1995. Bowman EM, Aigner TG, and Richmond BJ. Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards. J Neurophysiol 75: 1061-1073, 1996. Boysen ST, Berntson GG, and Mukobi KL. Size matters: impact of item size and quantity on array choice by chimpanzees (Pan troglodytes). J Comp Psych 115: 106 -110, 2001. Braver TS, Cohen JD, Nystrom LE, Jonides J, Smith EE, and Noll DD. A parametric study of prefrontal cortex involvement in human working memory. Neuroimage 5: 49 -62, 1997. Brown VJ and Bowman EM. Discriminative cues indicating reward magnitude continue to determine reaction time of rats following lesions to the nucleus accumbens. Eur J Neurosci 7: 2479 -2485, 1995. Campbell AB and Seiden LS. The effect of relative and absolute reinforcement magnitude on operant responding. Physiol Behav 12: 843-849, 1974. Capaldi EJ, Alptekin S, and Birmingham K. Discriminating between reward-produced memories: effects of differences in reward magnitude. Anim Learn Behav 25: 171-176, 1997. Capaldi EJ and Lynch D. Repeated shifts in reward magnitude: evidence in favor of an associational and absolute (noncontextual) interpretation. J Exp Psychol 75: 226 -235, 1967. Capaldi EJ and Lynch AD. Magnitude of partial reward and resistance to extinction. J Comp Physiol Psych 65: 179 -181, 1968. Cardinal RN, Pennicott DR, Sugathapala CL, Robbins TW, and Everitt BJ. Impulsive choice induced in rats by lesions of the nucleus accumbens core. Science 292: 2499 -2501, 2001. Catania AC. Concurrent performances: a baseline for the study of reinforcement magnitude. J Exp Anal Behav 6: 299 -300, 1963. Chang JY, Chen L, Luo F, Shi LH, and Woodward DJ. Neuronal and behavioral correlations in the medial prefrontal cortex and nucleus accumbens during cocaine self-administration by rats. Neuroscience 99: 433-443, 2000. Collier GH. Determinants of choice. Nebr Symp Motiv 29: 69 -127, 1982. Crespi LP. Quantitative variation in incentive and performance in the white rat. Am J Psych 40: 467-517, 1942. Critchley HG and Rolls ET. Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex. J Neurophysiol 75: 1673-1686, 1996. Cromwell HC, Azarov A, Anstrom K, and Woodward DJ. Neural responses in mesoamygdala circuits during associative learning. Soc Neurosci Abstr 27: 1588, 2001. Cromwell HC and Berridge KC. Implementation of action sequences by a neostriatal site: a lesion mapping study of grooming syntax. J Neurosci 16: 3444 -3458, 1996. Cromwell HC and Schultz W. Reward discrimination in primate striatum II. Reward magnitude. Soc Neurosci Abstr 26: 1753, 2000. DeCoteau WE, Kesner RP, and Williams JM. Short-term memory for food reward magnitude: the role of the prefrontal cortex. Behav Brain Res 88: 239 -249, 1997. Delong MR, Alexander GE, Mitchel SJ, and Richardson RT. The contribution of basal ganglia to limb control. Prog Brain Res 64: 161-174, 1986. Dickinson A and Balleine B. Motivational control of goal-directed action. processes in addiction and reward. The role of amygdala-ventral striatal subsystems. Ann NY Acad Sci 877: 412-438, 2000. Flaherty AW and Graybiel AM. Two input systems for body representations in the primate striatal matrix: experimental evidence in the squirrel monkey.
Rewards are often not only valued according to their physical characteristics but also relative to other available rewards. The striatum (caudate nucleus, putamen, ventral striatum including nucleus accumbens) is involved in the organization of movement and the processing of reward information. We studied the activity of single striatal neurons in macaques that were presented with different combinations of two rewards. We found in nearly half of the investigated neurons that the processing for one reward shifted, relative to the other rewards that were available in a given trial block. The relative reward processing concerned all forms of striatal activity related to reward-predicting visual stimuli, arm movements and reception of rewards. The observed changes may provide a neural basis for the known shifts in valuation of rewarding outcomes relative to known references.
REWARD DISCRIMINATION IN PRIMATE STRIATUM
Behavioural Pharmacology, 1998
Rewards are often not only valued according to their physical characteristics but also relative to other available rewards. The striatum (caudate nucleus, putamen, ventral striatum including nucleus accumbens) is involved in the organization of movement and the processing of reward information. We studied the activity of single striatal neurons in macaques that were presented with different combinations of two rewards. We found in nearly half of the investigated neurons that the processing for one reward shifted, relative to the other rewards that were available in a given trial block. The relative reward processing concerned all forms of striatal activity related to reward-predicting visual stimuli, arm movements and reception of rewards. The observed changes may provide a neural basis for the known shifts in valuation of rewarding outcomes relative to known references.
The Journal of neuroscience : the official journal of the Society for Neuroscience, 2014
Multiple features of the environment are often imbued with motivational significance, and the relative importance of these can change across contexts. The ability to flexibly adjust evaluative processes so that currently important features of the environment alone drive behavior is critical to adaptive routines. We know relatively little about the neural mechanisms involved, including whether motivationally significant features are obligatorily evaluated or whether current relevance gates access to value-sensitive regions. We addressed these questions using functional magnetic resonance imaging data and a task design where human subjects had to choose whether to accept or reject an offer indicated by visual and auditory stimuli. By manipulating, on a trial-by-trial basis, which stimulus determined the value of the offer, we show choice activity in the ventral striatum solely reflects the value of the currently relevant stimulus, consistent with a model wherein behavioral relevance modulates the impact of sensory stimuli on value processing. Choice outcome signals in this same region covaried positively with wins on accept trials, and negatively with wins on reject trials, consistent with striatal activity at feedback reflecting correctness of response rather than reward processing per se. We conclude that ventral striatum activity during decision making is dynamically modulated by behavioral context, indexed here by task relevance and action selection.
Journal of Neuroscience, 2011
The ability of human subjects to choose between disparate kinds of rewards suggests that the neural circuits for valuing different reward types must converge. Economic theory suggests that these convergence points represent the subjective values (SVs) of different reward types on a common scale for comparison. To examine these hypotheses and to map the neural circuits for reward valuation we had food and water-deprived subjects make risky choices for money, food, and water both in and out of a brain scanner. We found that risk preferences across reward types were highly correlated; the level of risk aversion an individual showed when choosing among monetary lotteries predicted their risk aversion toward food and water. We also found that partially distinct neural networks represent the SVs of monetary and food rewards and that these distinct networks showed specific convergence points. The hypothalamic region mainly represented the SV for food, and the posterior cingulate cortex mainly represented the SV for money. In both the ventromedial prefrontal cortex (vmPFC) and striatum there was a common area representing the SV of both reward types, but only the vmPFC significantly represented the SVs of money and food on a common scale appropriate for choice in our data set. A correlation analysis demonstrated interactions across money and food valuation areas and the common areas in the vmPFC and striatum. This may suggest that partially distinct valuation networks for different reward types converge on a unified valuation network, which enables a direct comparison between different reward types and hence guides valuation and choice.
Signatures of Value Comparison in Ventral Striatum Neurons
PLOS Biology, 2015
The ventral striatum (VS), like its cortical afferents, is closely associated with processing of rewards, but the relative contributions of striatal and cortical reward systems remains unclear. Most theories posit distinct roles for these structures, despite their similarities. We compared responses of VS neurons to those of ventromedial prefrontal cortex (vmPFC) Area 14 neurons, recorded in a risky choice task. Five major response patterns observed in vmPFC were also observed in VS: (1) offer value encoding, (2) value difference encoding, (3) preferential encoding of chosen relative to unchosen value, (4) a correlation between residual variance in responses and choices, and (5) prominent encoding of outcomes. We did observe some differences as well: in particular, preferential encoding of the chosen option was stronger and started earlier in VS than in vmPFC. Nonetheless, the close match between vmPFC and VS suggests that cortex and its striatal targets make overlapping contributions to economic choice.
Behavioural brain research, 2016
The striatum is a key structure involved in reward processing and choice. Recently, we have developed a paradigm to explore how components of reward processing work together or independently during choice behavior. These components include reward discrimination, preference and relative valuation, and the goal of the present study was to determine how the striatum is involved in these dissociable components during this novel free choice paradigm. We tested choice utilizing two different outcome series with one being a more straightforward single-option discrimination anchored by a 0 reward outcome, and the other as a multi-option outcome discrimination of greater difficulty. We compared the free choice reward task to a sequential reward task and an extinction task. Striatal lesions impaired responding only in the free choice version with alterations in both appetitive and consummatory measures. Ventral striatal lesions had greater impact altering discrimination, preference and relati...