Dopamine responses comply with basic assumptions of formal learning theory - PubMed (original) (raw)
. 2001 Jul 5;412(6842):43-8.
doi: 10.1038/35083500.
Affiliations
- PMID: 11452299
- DOI: 10.1038/35083500
Dopamine responses comply with basic assumptions of formal learning theory
P Waelti et al. Nature. 2001.
Abstract
According to contemporary learning theories, the discrepancy, or error, between the actual and predicted reward determines whether learning occurs when a stimulus is paired with a reward. The role of prediction errors is directly demonstrated by the observation that learning is blocked when the stimulus is paired with a fully predicted reward. By using this blocking procedure, we show that the responses of dopamine neurons to conditioned stimuli was governed differentially by the occurrence of reward prediction errors rather than stimulus-reward associations alone, as was the learning of behavioural reactions. Both behavioural and neuronal learning occurred predominantly when dopamine neurons registered a reward prediction error at the time of the reward. Our data indicate that the use of analytical tests derived from formal behavioural learning theory provides a powerful approach for studying the role of single neurons in learning.
Similar articles
- Dopamine neurons report an error in the temporal prediction of reward during learning.
Hollerman JR, Schultz W. Hollerman JR, et al. Nat Neurosci. 1998 Aug;1(4):304-9. doi: 10.1038/1124. Nat Neurosci. 1998. PMID: 10195164 - Predictive reward signal of dopamine neurons.
Schultz W. Schultz W. J Neurophysiol. 1998 Jul;80(1):1-27. doi: 10.1152/jn.1998.80.1.1. J Neurophysiol. 1998. PMID: 9658025 Review. - Neural coding of reward-prediction error signals during classical conditioning with attractive faces.
Bray S, O'Doherty J. Bray S, et al. J Neurophysiol. 2007 Apr;97(4):3036-45. doi: 10.1152/jn.01211.2006. Epub 2007 Feb 15. J Neurophysiol. 2007. PMID: 17303809 - Coding of predicted reward omission by dopamine neurons in a conditioned inhibition paradigm.
Tobler PN, Dickinson A, Schultz W. Tobler PN, et al. J Neurosci. 2003 Nov 12;23(32):10402-10. doi: 10.1523/JNEUROSCI.23-32-10402.2003. J Neurosci. 2003. PMID: 14614099 Free PMC article. - Involvement of basal ganglia and orbitofrontal cortex in goal-directed behavior.
Hollerman JR, Tremblay L, Schultz W. Hollerman JR, et al. Prog Brain Res. 2000;126:193-215. doi: 10.1016/S0079-6123(00)26015-9. Prog Brain Res. 2000. PMID: 11105648 Review.
Cited by
- Marine Ο-3 polyunsaturated fatty acids induce sex-specific changes in reinforcer-controlled behaviour and neurotransmitter metabolism in a spontaneously hypertensive rat model of ADHD.
Dervola KS, Roberg BA, Wøien G, Bogen IL, Sandvik TH, Sagvolden T, Drevon CA, Johansen EB, Walaas SI. Dervola KS, et al. Behav Brain Funct. 2012 Dec 10;8:56. doi: 10.1186/1744-9081-8-56. Behav Brain Funct. 2012. PMID: 23228189 Free PMC article. - Dopamine dependence in aggregate feedback learning: A computational cognitive neuroscience approach.
Valentin VV, Maddox WT, Ashby FG. Valentin VV, et al. Brain Cogn. 2016 Nov;109:1-18. doi: 10.1016/j.bandc.2016.06.002. Epub 2016 Sep 3. Brain Cogn. 2016. PMID: 27596541 Free PMC article. - Heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales.
Baudonnat M, Huber A, David V, Walton ME. Baudonnat M, et al. Front Neurosci. 2013 Oct 11;7:175. doi: 10.3389/fnins.2013.00175. Front Neurosci. 2013. PMID: 24130514 Free PMC article. Review. - Roles of Octopamine and Dopamine Neurons for Mediating Appetitive and Aversive Signals in Pavlovian Conditioning in Crickets.
Mizunami M, Matsumoto Y. Mizunami M, et al. Front Physiol. 2017 Dec 12;8:1027. doi: 10.3389/fphys.2017.01027. eCollection 2017. Front Physiol. 2017. PMID: 29311961 Free PMC article. Review. - Dysregulation of dopamine and glutamate release in the prefrontal cortex and nucleus accumbens following methamphetamine self-administration and during reinstatement in rats.
Parsegian A, See RE. Parsegian A, et al. Neuropsychopharmacology. 2014 Mar;39(4):811-22. doi: 10.1038/npp.2013.231. Epub 2013 Sep 2. Neuropsychopharmacology. 2014. PMID: 23995583 Free PMC article.
Publication types
MeSH terms
Substances
LinkOut - more resources
Full Text Sources
Other Literature Sources