A cellular mechanism of reward-related learning - PubMed (original) (raw)
. 2001 Sep 6;413(6851):67-70.
doi: 10.1038/35092560.
Affiliations
- PMID: 11544526
- DOI: 10.1038/35092560
A cellular mechanism of reward-related learning
J N Reynolds et al. Nature. 2001.
Abstract
Positive reinforcement helps to control the acquisition of learned behaviours. Here we report a cellular mechanism in the brain that may underlie the behavioural effects of positive reinforcement. We used intracranial self-stimulation (ICSS) as a model of reinforcement learning, in which each rat learns to press a lever that applies reinforcing electrical stimulation to its own substantia nigra. The outputs from neurons of the substantia nigra terminate on neurons in the striatum in close proximity to inputs from the cerebral cortex on the same striatal neurons. We measured the effect of substantia nigra stimulation on these inputs from the cortex to striatal neurons and also on how quickly the rats learned to press the lever. We found that stimulation of the substantia nigra (with the optimal parameters for lever-pressing behaviour) induced potentiation of synapses between the cortex and the striatum, which required activation of dopamine receptors. The degree of potentiation within ten minutes of the ICSS trains was correlated with the time taken by the rats to learn ICSS behaviour. We propose that stimulation of the substantia nigra when the lever is pressed induces a similar potentiation of cortical inputs to the striatum, positively reinforcing the learning of the behaviour by the rats.
Similar articles
- Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning.
Haruno M, Kawato M. Haruno M, et al. Neural Netw. 2006 Oct;19(8):1242-54. doi: 10.1016/j.neunet.2006.06.007. Epub 2006 Sep 20. Neural Netw. 2006. PMID: 16987637 - Involvement of basal ganglia and orbitofrontal cortex in goal-directed behavior.
Hollerman JR, Tremblay L, Schultz W. Hollerman JR, et al. Prog Brain Res. 2000;126:193-215. doi: 10.1016/S0079-6123(00)26015-9. Prog Brain Res. 2000. PMID: 11105648 Review. - Behavioral characterization of intracranial self-stimulation from mesolimbic, mesocortical, nigrostriatal, hypothalamic and extra-hypothalamic sites in the non-inbred CD-1 mouse strain.
Zacharko RM, Kasian M, Irwin J, Zalcman S, LaLonde G, MacNeil G, Anisman H. Zacharko RM, et al. Behav Brain Res. 1990 Jan 22;36(3):251-81. doi: 10.1016/0166-4328(90)90062-j. Behav Brain Res. 1990. PMID: 2310489 - Dopamine's Effects on Corticostriatal Synapses during Reward-Based Behaviors.
Bamford NS, Wightman RM, Sulzer D. Bamford NS, et al. Neuron. 2018 Feb 7;97(3):494-510. doi: 10.1016/j.neuron.2018.01.006. Neuron. 2018. PMID: 29420932 Free PMC article. Review.
Cited by
- Computing reward-prediction error: an integrated account of cortical timing and basal-ganglia pathways for appetitive and aversive learning.
Morita K, Kawaguchi Y. Morita K, et al. Eur J Neurosci. 2015 Aug;42(4):2003-21. doi: 10.1111/ejn.12994. Epub 2015 Jul 25. Eur J Neurosci. 2015. PMID: 26095906 Free PMC article. - Condition interference in rats performing a choice task with switched variable- and fixed-reward conditions.
Funamizu A, Ito M, Doya K, Kanzaki R, Takahashi H. Funamizu A, et al. Front Neurosci. 2015 Feb 13;9:27. doi: 10.3389/fnins.2015.00027. eCollection 2015. Front Neurosci. 2015. PMID: 25741231 Free PMC article. - Corticostriatal neurons in auditory cortex drive decisions during auditory discrimination.
Znamenskiy P, Zador AM. Znamenskiy P, et al. Nature. 2013 May 23;497(7450):482-5. doi: 10.1038/nature12077. Epub 2013 May 1. Nature. 2013. PMID: 23636333 Free PMC article. - Role of DARPP-32 and ARPP-21 in the Emergence of Temporal Constraints on Striatal Calcium and Dopamine Integration.
Nair AG, Bhalla US, Hellgren Kotaleski J. Nair AG, et al. PLoS Comput Biol. 2016 Sep 1;12(9):e1005080. doi: 10.1371/journal.pcbi.1005080. eCollection 2016 Sep. PLoS Comput Biol. 2016. PMID: 27584878 Free PMC article. - Striatal cholinergic dysfunction as a unifying theme in the pathophysiology of dystonia.
Eskow Jaunarajs KL, Bonsi P, Chesselet MF, Standaert DG, Pisani A. Eskow Jaunarajs KL, et al. Prog Neurobiol. 2015 Apr;127-128:91-107. doi: 10.1016/j.pneurobio.2015.02.002. Epub 2015 Feb 17. Prog Neurobiol. 2015. PMID: 25697043 Free PMC article. Review.
Publication types
MeSH terms
Substances
LinkOut - more resources
Full Text Sources
Other Literature Sources