A selective role for dopamine in stimulus–reward learning (original) (raw)

References

  1. Schultz, W. Behavioral theories and the neurophysiology of reward. Annu. Rev. Psychol. 57, 87–115 (2006)
    Article Google Scholar
  2. Wise, R. A. Dopamine, learning and motivation. Nature Rev. Neurosci. 5, 483–494 (2004)
    Article CAS Google Scholar
  3. Day, J. J., Roitman, M. F., Wightman, R. M. & Carelli, R. M. Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens. Nature Neurosci. 10, 1020–1028 (2007)
    Article CAS Google Scholar
  4. Schultz, W., Dayan, P. & Montague, P. R. A neural substrate of prediction and reward. Science 275, 1593–1599 (1997)
    Article CAS Google Scholar
  5. Montague, P. R., Dayan, P. & Sejnowski, T. J. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J. Neurosci. 16, 1936–1947 (1996)
    Article CAS Google Scholar
  6. Waelti, P., Dickinson, A. & Schultz, W. Dopamine responses comply with basic assumptions of formal learning theory. Nature 412, 43–48 (2001)
    Article ADS CAS Google Scholar
  7. Balleine, B. W., Daw, N. D. & O’Doherty, J. P. in Neuroeconomics: Decision Making and the Brain (eds Glimcher, P. W., Camerer, C. F., Fehr, E. & Poldrack, R. A.) 367–389 (Academic Press, 2008)
    Google Scholar
  8. Berridge, K. C. The debate over dopamine’s role in reward: the case for incentive salience. Psychopharmacology 191, 391–431 (2007)
    Article CAS Google Scholar
  9. Berridge, K. C. & Robinson, T. E. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res. Brain Res. Rev. 28, 309–369 (1998)
    Article CAS Google Scholar
  10. Berridge, K. C., Robinson, T. E. & Aldridge, J. W. Dissecting components of reward: 'liking', 'wanting', and learning. Curr. Opin. Pharmacol. 9, 65–73 (2009)
    Article CAS Google Scholar
  11. Panksepp, J. Affective consciousness: core emotional feelings in animals and humans. Conscious. Cogn. 14, 30–80 (2005)
    Article Google Scholar
  12. Hearst, E. & Jenkins, H. Sign-Tracking: The Stimulus-Reinforcer Relation and Directed Action (Monograph of the Psychonomic Society, 1974)
    Google Scholar
  13. Boakes, R. in Operant-Pavlovian Interactions (eds Davis, H. & Hurwitz, H. M. B.) 67–97 (Erlbaum, 1977)
    Google Scholar
  14. Robinson, T. E. & Flagel, S. B. Dissociating the predictive and incentive motivational properties of reward-related cues through the study of individual differences. Biol. Psychiat. 65, 869–873 (2009)
    Article Google Scholar
  15. Stead, J. D. et al. Selective breeding for divergence in novelty-seeking traits: heritability and enrichment in spontaneous anxiety-related behaviors. Behav. Genet. 36, 697–712 (2006)
    Article Google Scholar
  16. Flagel, S. B. et al. An animal model of genetic vulnerability to behavioral disinhibition and responsiveness to reward-related cues: implications for addiction. Neuropsychopharmacology 35, 388–400 (2010)
    Article Google Scholar
  17. Berridge, K. C. in Psychology of Learning and Motivation (ed. Medin, D. L.) 223–278 (Academic Press, 2001)
    Google Scholar
  18. Cardinal, R. N., Parkinson, J. A., Hall, J. & Everitt, B. J. Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci. Biobehav. Rev. 26, 321–352 (2002)
    Article Google Scholar
  19. Kelley, A. E. Functional specificity of ventral striatal compartments in appetitive behaviors. Ann. NY Acad. Sci. 877, 71–90 (1999)
    Article ADS CAS Google Scholar
  20. Dalley, J. W. et al. Time-limited modulation of appetitive Pavlovian memory by D1 and NMDA receptors in the nucleus accumbens. Proc. Natl Acad. Sci. USA 102, 6189–6194 (2005)
    Article ADS CAS Google Scholar
  21. Di Ciano, P., Cardinal, R. N., Cowell, R. A., Little, S. J. & Everitt, B. J. Differential involvement of NMDA, AMPA/kainate, and dopamine receptors in the nucleus accumbens core in the acquisition and performance of pavlovian approach behavior. J. Neurosci. 21, 9471–9477 (2001)
    Article CAS Google Scholar
  22. Parkinson, J. A. et al. Nucleus accumbens dopamine depletion impairs both acquisition and performance of appetitive Pavlovian approach behaviour: implications for mesoaccumbens dopamine function. Behav. Brain Res. 137, 149–163 (2002)
    Article CAS Google Scholar
  23. Parkinson, J. A., Olmstead, M. C., Burns, L. H., Robbins, T. W. & Everitt, B. J. Dissociation in effects of lesions of the nucleus accumbens core and shell on appetitive pavlovian approach behavior and the potentiation of conditioned reinforcement and locomotor activity by D-amphetamine. J. Neurosci. 19, 2401–2411 (1999)
    Article CAS Google Scholar
  24. Clark, J. J. et al. Chronic microsensors for longitudinal, subsecond dopamine detection in behaving animals. Nature Methods 7, 126–129 (2010)
    Article CAS Google Scholar
  25. Robinson, T. E. & Berridge, K. C. The neural basis of drug craving: an incentive-sensitization theory of addiction. Brain Res. Brain Res. Rev. 18, 247–291 (1993)
    Article CAS Google Scholar
  26. Tindell, A. J., Smith, K. S., Berridge, K. C. & Aldridge, J. W. Dynamic computation of incentive salience: "wanting" what was never "liked". J. Neurosci. 29, 12220–12228 (2009)
    Article CAS Google Scholar
  27. Zhang, J., Berridge, K. C., Tindell, A. J., Smith, K. S. & Aldridge, J. W. A neural computational model of incentive salience. PLOS Comput. Biol. 5, e1000437 (2009)
    Article ADS MathSciNet Google Scholar
  28. Beckmann, J. S., Marusich, J. A., Gipson, C. D. & Bardo, M. T. Novelty seeking, incentive salience and acquisition of cocaine self-administration in the rat. Behav. Brain Res. 216, 159–165 (2011)
    Article CAS Google Scholar
  29. Wyvell, C. L. & Berridge, K. C. Intra-accumbens amphetamine increases the conditioned incentive salience of sucrose reward: enhancement of reward "wanting" without enhanced "liking" or response reinforcement. J. Neurosci. 20, 8122–8130 (2000)
    Article CAS Google Scholar
  30. Wyvell, C. L. & Berridge, K. C. Incentive sensitization by previous amphetamine exposure: increased cue-triggered "wanting" for sucrose reward. J. Neurosci. 21, 7831–7840 (2001)
    Article CAS Google Scholar
  31. Tomie, A., Aguado, A. S., Pohorecky, L. A. & Benjamin, D. Ethanol induces impulsive-like responding in a delay-of-reward operant choice procedure: impulsivity predicts autoshaping. Psychopharmacology 139, 376–382 (1998)
    Article CAS Google Scholar
  32. Kuo, W. J., Sjostrom, T., Chen, Y. P., Wang, Y. H. & Huang, C. Y. Intuition and deliberation: two systems for strategizing in the brain. Science 324, 519–522 (2009)
    Article ADS CAS Google Scholar
  33. Clinton, S. M, et al. Individual differences in novelty-seeking and emotional reactivity correlate with variation in maternal behavior. Horm. Behav. 51, 655–664 (2007)
    Article Google Scholar
  34. Verbeke, G. &. Molenberghs, G. Linear Mixed Models for Longitudinal Data (Springer, 2000)
    MATH Google Scholar
  35. Heien, M. L. Johnson, M. A. & Wightman, R. M. Resolving neurotransmitters detected by fast-scan cyclic voltammetry. Anal. Chem. 76, 5697–5704 (2004)
    Article CAS Google Scholar

Download references