Is the short-latency dopamine response too short to signal reward error? - PubMed (original) (raw)
Review
Is the short-latency dopamine response too short to signal reward error?
P Redgrave et al. Trends Neurosci. 1999 Apr.
Free article
Abstract
Unexpected stimuli that are behaviourally significant have the capacity to elicit a short-latency, short-duration burst of firing in mesencephalic dopaminergic neurones. An influential interpretation of the experimental data that characterize this response proposes that dopaminergic neurones have a crucial role in reinforcement learning because they signal error in the prediction of future reward. In this article we propose a different functional role for this 'short-latency dopamine response' in the mechanisms that underlie associative learning. We suggest that the initial burst of dopaminergic-neurone firing could represent an essential component in the process of switching attentional and behavioural selections to unexpected, behaviourally important stimuli. This switching response could be a crucial prerequisite for associative learning and might be part of a general short-latency response that is mediated by catecholamines and prepares the organism for an appropriate reaction to biologically significant events. Any act which in a given situation produces satisfaction becomes associated with that situation so that when the situation recurs the act is more likely than before to recur also. E.L. Thorndike (1911) 1.
Similar articles
- A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task.
Suri RE, Schultz W. Suri RE, et al. Neuroscience. 1999;91(3):871-90. doi: 10.1016/s0306-4522(98)00697-6. Neuroscience. 1999. PMID: 10391468 - Involvement of basal ganglia and orbitofrontal cortex in goal-directed behavior.
Hollerman JR, Tremblay L, Schultz W. Hollerman JR, et al. Prog Brain Res. 2000;126:193-215. doi: 10.1016/S0079-6123(00)26015-9. Prog Brain Res. 2000. PMID: 11105648 Review. - Optogenetic Blockade of Dopamine Transients Prevents Learning Induced by Changes in Reward Features.
Chang CY, Gardner M, Di Tillio MG, Schoenbaum G. Chang CY, et al. Curr Biol. 2017 Nov 20;27(22):3480-3486.e3. doi: 10.1016/j.cub.2017.09.049. Epub 2017 Nov 2. Curr Biol. 2017. PMID: 29103933 Free PMC article. - The short-latency dopamine signal: a role in discovering novel actions?
Redgrave P, Gurney K. Redgrave P, et al. Nat Rev Neurosci. 2006 Dec;7(12):967-75. doi: 10.1038/nrn2022. Epub 2006 Nov 8. Nat Rev Neurosci. 2006. PMID: 17115078 Review. - Modeling functions of striatal dopamine modulation in learning and planning.
Suri RE, Bargas J, Arbib MA. Suri RE, et al. Neuroscience. 2001;103(1):65-85. doi: 10.1016/s0306-4522(00)00554-6. Neuroscience. 2001. PMID: 11311788
Cited by
- Neuronal Reward and Decision Signals: From Theories to Data.
Schultz W. Schultz W. Physiol Rev. 2015 Jul;95(3):853-951. doi: 10.1152/physrev.00023.2014. Physiol Rev. 2015. PMID: 26109341 Free PMC article. Review. - Individual variation in resisting temptation: implications for addiction.
Saunders BT, Robinson TE. Saunders BT, et al. Neurosci Biobehav Rev. 2013 Nov;37(9 Pt A):1955-75. doi: 10.1016/j.neubiorev.2013.02.008. Epub 2013 Feb 21. Neurosci Biobehav Rev. 2013. PMID: 23438893 Free PMC article. Review. - Acquisition of "Start" and "Stop" response thresholds in peak-interval timing is differentially sensitive to protein synthesis inhibition in the dorsal and ventral striatum.
Macdonald CJ, Cheng RK, Meck WH. Macdonald CJ, et al. Front Integr Neurosci. 2012 Mar 14;6:10. doi: 10.3389/fnint.2012.00010. eCollection 2012. Front Integr Neurosci. 2012. PMID: 22435054 Free PMC article. - Neuronal activity in the substantia nigra in the anaesthetized rat has fractal characteristics. Evidence for firing-code patterns in the basal ganglia.
Rodríguez M, Pereda E, González J, Abdala P, Obeso JA. Rodríguez M, et al. Exp Brain Res. 2003 Jul;151(2):167-72. doi: 10.1007/s00221-003-1442-4. Epub 2003 May 27. Exp Brain Res. 2003. PMID: 12768261 - Differential roles of dopamine D1 and D2 receptors in the nucleus accumbens in attentional performance on the five-choice serial reaction time task.
Pezze MA, Dalley JW, Robbins TW. Pezze MA, et al. Neuropsychopharmacology. 2007 Feb;32(2):273-83. doi: 10.1038/sj.npp.1301073. Epub 2006 Apr 12. Neuropsychopharmacology. 2007. PMID: 16641946 Free PMC article.
Publication types
MeSH terms
Substances
LinkOut - more resources
Full Text Sources