Dopamine responses comply with basic assumptions of formal learning theory - PubMed (original) (raw)
. 2001 Jul 5;412(6842):43-8.
doi: 10.1038/35083500.
Affiliations
- PMID: 11452299
- DOI: 10.1038/35083500
Dopamine responses comply with basic assumptions of formal learning theory
P Waelti et al. Nature. 2001.
Abstract
According to contemporary learning theories, the discrepancy, or error, between the actual and predicted reward determines whether learning occurs when a stimulus is paired with a reward. The role of prediction errors is directly demonstrated by the observation that learning is blocked when the stimulus is paired with a fully predicted reward. By using this blocking procedure, we show that the responses of dopamine neurons to conditioned stimuli was governed differentially by the occurrence of reward prediction errors rather than stimulus-reward associations alone, as was the learning of behavioural reactions. Both behavioural and neuronal learning occurred predominantly when dopamine neurons registered a reward prediction error at the time of the reward. Our data indicate that the use of analytical tests derived from formal behavioural learning theory provides a powerful approach for studying the role of single neurons in learning.
Similar articles
- Dopamine neurons report an error in the temporal prediction of reward during learning.
Hollerman JR, Schultz W. Hollerman JR, et al. Nat Neurosci. 1998 Aug;1(4):304-9. doi: 10.1038/1124. Nat Neurosci. 1998. PMID: 10195164 - Predictive reward signal of dopamine neurons.
Schultz W. Schultz W. J Neurophysiol. 1998 Jul;80(1):1-27. doi: 10.1152/jn.1998.80.1.1. J Neurophysiol. 1998. PMID: 9658025 Review. - Coding of predicted reward omission by dopamine neurons in a conditioned inhibition paradigm.
Tobler PN, Dickinson A, Schultz W. Tobler PN, et al. J Neurosci. 2003 Nov 12;23(32):10402-10. doi: 10.1523/JNEUROSCI.23-32-10402.2003. J Neurosci. 2003. PMID: 14614099 Free PMC article. - Neural coding of reward-prediction error signals during classical conditioning with attractive faces.
Bray S, O'Doherty J. Bray S, et al. J Neurophysiol. 2007 Apr;97(4):3036-45. doi: 10.1152/jn.01211.2006. Epub 2007 Feb 15. J Neurophysiol. 2007. PMID: 17303809 - Involvement of basal ganglia and orbitofrontal cortex in goal-directed behavior.
Hollerman JR, Tremblay L, Schultz W. Hollerman JR, et al. Prog Brain Res. 2000;126:193-215. doi: 10.1016/S0079-6123(00)26015-9. Prog Brain Res. 2000. PMID: 11105648 Review.
Cited by
- Dopamine neurons drive spatiotemporally heterogeneous striatal dopamine signals during learning.
Engel L, Wolff AR, Blake M, Collins VL, Sinha S, Saunders BT. Engel L, et al. Curr Biol. 2024 Jul 22;34(14):3086-3101.e4. doi: 10.1016/j.cub.2024.05.069. Epub 2024 Jun 25. Curr Biol. 2024. PMID: 38925117 - Learning to express reward prediction error-like dopaminergic activity requires plastic representations of time.
Cone I, Clopath C, Shouval HZ. Cone I, et al. Nat Commun. 2024 Jul 12;15(1):5856. doi: 10.1038/s41467-024-50205-3. Nat Commun. 2024. PMID: 38997276 Free PMC article. - A causal link between prediction errors, dopamine neurons and learning.
Steinberg EE, Keiflin R, Boivin JR, Witten IB, Deisseroth K, Janak PH. Steinberg EE, et al. Nat Neurosci. 2013 Jul;16(7):966-73. doi: 10.1038/nn.3413. Epub 2013 May 26. Nat Neurosci. 2013. PMID: 23708143 Free PMC article. - Olfactory blocking and odorant similarity in the honeybee.
Guerrieri F, Lachnit H, Gerber B, Giurfa M. Guerrieri F, et al. Learn Mem. 2005 Mar-Apr;12(2):86-95. doi: 10.1101/lm.79305. Learn Mem. 2005. PMID: 15805307 Free PMC article. - Dopamine operates as a subsecond modulator of food seeking.
Roitman MF, Stuber GD, Phillips PE, Wightman RM, Carelli RM. Roitman MF, et al. J Neurosci. 2004 Feb 11;24(6):1265-71. doi: 10.1523/JNEUROSCI.3823-03.2004. J Neurosci. 2004. PMID: 14960596 Free PMC article.
Publication types
MeSH terms
Substances
LinkOut - more resources
Full Text Sources
Other Literature Sources