Relative reward processing in primate striatum (original) (raw)

REWARD DISCRIMINATION IN PRIMATE STRIATUM

Behavioural Pharmacology, 1998

Rewards are often not only valued according to their physical characteristics but also relative to other available rewards. The striatum (caudate nucleus, putamen, ventral striatum including nucleus accumbens) is involved in the organization of movement and the processing of reward information. We studied the activity of single striatal neurons in macaques that were presented with different combinations of two rewards. We found in nearly half of the investigated neurons that the processing for one reward shifted, relative to the other rewards that were available in a given trial block. The relative reward processing concerned all forms of striatal activity related to reward-predicting visual stimuli, arm movements and reception of rewards. The observed changes may provide a neural basis for the known shifts in valuation of rewarding outcomes relative to known references.

Relative reward effect

Reward Inference by Primate Prefrontal and Striatal Neurons

Journal of Neuroscience, 2014

The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Importantly, these LPFC neurons could predict the reward value of a stimulus using transitive inference even when the monkeys had not yet learned the stimulus-reward association directly; whereas these striatal neurons did not show such an ability. Nevertheless, because there were two set amounts of reward (large and small), the selected striatal neurons were able to exclusively infer the reward value (e.g., large) of one novel stimulus from a pair after directly experiencing the alternative stimulus with the other reward value (e.g., small). Our results suggest that although neurons that predict reward value for old stimuli in the LPFC could also do so for new stimuli via transitive inference, those in the striatum could only predict reward for new stimuli via exclusive inference. Moreover, the striatum showed more complex functions than was surmised previously for model-free learning.

Striatal Activity and Reward Relativity: Neural Signals Encoding Dynamic Outcome Valuation

eNeuro

The striatum is a key brain region involved in reward processing. Striatal activity has been linked to encoding reward magnitude and integrating diverse reward outcome information. Recent work has supported the involvement of striatum in the valuation of outcomes. The present work extends this idea by examining striatal activity during dynamic shifts in value that include different levels and directions of magnitude disparity. A novel task was used to produce diverse relative reward effects on a chain of instrumental action. Rats (Rattus norvegicus) were trained to respond to cues associated with specific outcomes varying by food pellet magnitude. Animals were exposed to single-outcome sessions followed by mixed-outcome sessions, and neural activity was compared among identical outcome trials from the different behavioral contexts. Results recording striatal activity show that neural responses to different task elements reflect incentive contrast as well as other relative effects that involve generalization between outcomes or possible influences of outcome variety. The activity that was most prevalent was linked to food consumption and post-food consumption periods. Relative encoding was sensitive to magnitude disparity. A within-session analysis showed strong contrast effects that were dependent upon the outcome received in the immediately preceding trial. Significantly higher numbers of responses were found in ventral striatum linked to relative outcome effects. Our results support the idea that relative value can incorporate diverse relationships, including comparisons from specific individual outcomes to general behavioral contexts. The striatum contains these diverse relative processes, possibly enabling both a higher information yield concerning value shifts and a greater behavioral flexibility.

Representation of Action-Specific Reward Values in the Striatum

Science, 2005

The estimation of the reward an action will yield is critical in decision-making. To elucidate the role of the basal ganglia in this process, we recorded striatal neurons of monkeys who chose between left and right handle turns, based on the estimated reward probabilities of the actions. During a delay period before the choices, the activity of more than one-third of striatal projection neurons was selective to the values of one of the two actions. Fewer neurons were tuned to relative values or action choice. These results suggest representation of action values in the striatum, which can guide action selection in the basal ganglia circuit.

Effects of Expectations for Different Reward Magnitudes on Neuronal Activity in Primate Striatum

Journal of Neurophysiology, 2003

Caudate Nucleus [PDF] [Full Text] [Abstract] , April , 2014; 21 (4): 223-231. Learn. Mem. accumbens shell during specific time segments Behavioral flexibility is increased by optogenetic inhibition of neurons in the nucleus [PDF] [Full Text] [Abstract] , June , 2014; 9 (6): 864-872. Soc Cogn Affect Neurosci Neural correlates of effective and ineffective mood induction [PDF] [Full Text] [Abstract] 2014; 83 (12): 1112-1118. Neurology Fabienne Picard and Karl Friston Predictions, perception, and a sense of self [PDF] [Full Text] [Abstract] , October 15, 2014; 34 (42): 14147-14162. Downloaded from duces aphagia and exaggerated treading following striatopallidal lesions in the rat. Behav Neurosci 104: 778 -795, 1990. Black RW. Shifts in magnitude of reward and contrast effects in instrumental and selective learning: a reinterpretation. Psych Rev 75: 114 -126, 1968. Bloomfield TM. Behavioral contrast and relative reinforcement frequency in two multiple schedules. J Exp Anal Behav 10: 151-158, 1967. Blough PM. Overall and local contrast in multiple schedules: effects of stimulus similarity and discrimination performance. Anim Learn Behav 16: 395-403, 1988. Boussaoud D. Attention versus intention in the primate premotor cortex. Neuroimage 14: S40 -S45, 2001. Boussaoud D, di Pellegrino G, and Wise SP. Frontal lobe mechanisms subserving vision for action versus vision for perception. Behav Brain Res 72: 1-15, 1995. Bowman EM, Aigner TG, and Richmond BJ. Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards. J Neurophysiol 75: 1061-1073, 1996. Boysen ST, Berntson GG, and Mukobi KL. Size matters: impact of item size and quantity on array choice by chimpanzees (Pan troglodytes). J Comp Psych 115: 106 -110, 2001. Braver TS, Cohen JD, Nystrom LE, Jonides J, Smith EE, and Noll DD. A parametric study of prefrontal cortex involvement in human working memory. Neuroimage 5: 49 -62, 1997. Brown VJ and Bowman EM. Discriminative cues indicating reward magnitude continue to determine reaction time of rats following lesions to the nucleus accumbens. Eur J Neurosci 7: 2479 -2485, 1995. Campbell AB and Seiden LS. The effect of relative and absolute reinforcement magnitude on operant responding. Physiol Behav 12: 843-849, 1974. Capaldi EJ, Alptekin S, and Birmingham K. Discriminating between reward-produced memories: effects of differences in reward magnitude. Anim Learn Behav 25: 171-176, 1997. Capaldi EJ and Lynch D. Repeated shifts in reward magnitude: evidence in favor of an associational and absolute (noncontextual) interpretation. J Exp Psychol 75: 226 -235, 1967. Capaldi EJ and Lynch AD. Magnitude of partial reward and resistance to extinction. J Comp Physiol Psych 65: 179 -181, 1968. Cardinal RN, Pennicott DR, Sugathapala CL, Robbins TW, and Everitt BJ. Impulsive choice induced in rats by lesions of the nucleus accumbens core. Science 292: 2499 -2501, 2001. Catania AC. Concurrent performances: a baseline for the study of reinforcement magnitude. J Exp Anal Behav 6: 299 -300, 1963. Chang JY, Chen L, Luo F, Shi LH, and Woodward DJ. Neuronal and behavioral correlations in the medial prefrontal cortex and nucleus accumbens during cocaine self-administration by rats. Neuroscience 99: 433-443, 2000. Collier GH. Determinants of choice. Nebr Symp Motiv 29: 69 -127, 1982. Crespi LP. Quantitative variation in incentive and performance in the white rat. Am J Psych 40: 467-517, 1942. Critchley HG and Rolls ET. Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex. J Neurophysiol 75: 1673-1686, 1996. Cromwell HC, Azarov A, Anstrom K, and Woodward DJ. Neural responses in mesoamygdala circuits during associative learning. Soc Neurosci Abstr 27: 1588, 2001. Cromwell HC and Berridge KC. Implementation of action sequences by a neostriatal site: a lesion mapping study of grooming syntax. J Neurosci 16: 3444 -3458, 1996. Cromwell HC and Schultz W. Reward discrimination in primate striatum II. Reward magnitude. Soc Neurosci Abstr 26: 1753, 2000. DeCoteau WE, Kesner RP, and Williams JM. Short-term memory for food reward magnitude: the role of the prefrontal cortex. Behav Brain Res 88: 239 -249, 1997. Delong MR, Alexander GE, Mitchel SJ, and Richardson RT. The contribution of basal ganglia to limb control. Prog Brain Res 64: 161-174, 1986. Dickinson A and Balleine B. Motivational control of goal-directed action. processes in addiction and reward. The role of amygdala-ventral striatal subsystems. Ann NY Acad Sci 877: 412-438, 2000. Flaherty AW and Graybiel AM. Two input systems for body representations in the primate striatal matrix: experimental evidence in the squirrel monkey.

Cromwell Relative Reward Striatal Activity.pdf

2017

A neuronal reward inequity signal in primate striatum

Primates are social animals, and their survival depends on social interactions with others. Especially important for social interactions and welfare is the observation of rewards obtained by other individuals and the comparison with own reward. The fundamental social decision variable for the comparison process is reward inequity, defined by an asymmetric reward distribution among individuals. An important brain structure for coding reward inequity may be the striatum, a component of the basal ganglia involved in goal-directed behavior. Two rhesus monkeys were seated opposite each other and contacted a touch-sensitive table placed between them to obtain specific magnitudes of reward that were equally or unequally distributed among them. Response times in one of the animals demonstrated differential behavioral sensitivity to reward inequity. A group of neurons in the striatum showed distinct signals reflecting disadvantageous and advantageous reward inequity. These neuronal signals occurred irrespective of, or in conjunction with, own reward coding. These data demonstrate that striatal neurons of macaque monkeys sense the differences between other’s and own reward. The neuronal activities are likely to contribute crucial reward information to neuronal mechanisms involved in social interactions.

Influence of Reward Expectation on Behavior-Related Neuronal Activity in Primate Striatum

Journal of Neurophysiology, 1998

Hollerman, Jeffrey R., Léon Tremblay, and Wolfram Schultz. Influence of reward expectation on behavior-related neuronal activity in primate striatum. J. Neurophysiol. 80: 947–963, 1998. Rewards constitute important goals for voluntary behavior. This study aimed to investigate how expected rewards influence behavior-related neuronal activity in the anterior striatum. In a delayed go-nogo task, monkeys executed or withheld a reaching movement and obtained liquid or sound as reinforcement. An initial instruction picture indicated the behavioral reaction to be performed and the reinforcer to be obtained after a subsequent trigger stimulus. Movements varied according to the reinforcers predicted by the instructions, suggesting that animals differentially expected the two outcomes. About 250 of nearly 1,500 neurons in anterior parts of caudate nucleus, putamen, and ventral striatum showed typical task-related activations that reflected the expectation of instructions and trigger, and the ...

Annals of the New York Academy of Sciences, 2007

Much of our knowledge of how reward information is processed in the brain comes from a rich animal literature. Recently, the advancement of neuroimaging techniques has allowed researchers to extend such investigations to the human brain. A common finding across species and methodologies is the involvement of the striatum, the input structure of the basal ganglia, in a circuit responsible for mediating goaldirected behavior. Central to this idea is the role of the striatum in the processing of affective stimuli, such as rewards and punishments. The goal of this article is to probe the human reward circuit, specifically the striatum and its subdivisions, with an emphasis on how the affective properties of outcomes or feedback influence the underlying neural activity and subsequent decision making. Discussion will first focus on anatomical and functional considerations regarding the striatum that have emerged from animal models. The rest of the article will center on how human neuroimaging studies map to findings from the animal literature, and how more recently, this research can be extended into the social and economic domains.

Relative reward processing in primate striatum (original) (raw)

Related papers