Statistics of midbrain dopamine neuron spike trains in the awake primate - PubMed (original) (raw)
. 2007 Sep;98(3):1428-39.
doi: 10.1152/jn.01140.2006. Epub 2007 Jul 5.
Affiliations
- PMID: 17615124
- DOI: 10.1152/jn.01140.2006
Free article
Statistics of midbrain dopamine neuron spike trains in the awake primate
Hannah M Bayer et al. J Neurophysiol. 2007 Sep.
Free article
Abstract
Work in behaving primates indicates that midbrain dopamine neurons encode a prediction error, the difference between an obtained reward and the reward expected. Studies of dopamine action potential timing in the alert and anesthetized rat indicate that dopamine neurons respond in tonic and phasic modes, a distinction that has been less well characterized in the primates. We used spike train models to examine the relationship between the tonic and burst modes of activity in dopamine neurons while monkeys were performing a reinforced visuo-saccadic movement task. We studied spiking activity during four task-related intervals; two of these were intervals during which no task-related events occurred, whereas two were periods marked by task-related phasic activity. We found that dopamine neuron spike trains during the intervals when no events occurred were well described as tonic. Action potentials appeared to be independent, to occur at low frequency, and to be almost equally well described by Gaussian and Poisson-like (gamma) processes. Unlike in the rat, interspike intervals as low as 20 ms were often observed during these presumptively tonic epochs. Having identified these periods of presumptively tonic activity, we were able to quantitatively define phasic modulations (both increases and decreases in activity) during the intervals in which task-related events occurred. This analysis revealed that the phasic modulations of these neurons include both bursting, as has been described previously, and pausing. Together bursts and pauses seemed to provide a continuous, although nonlinear, representation of the theoretically defined reward prediction error of reinforcement learning.
Similar articles
- Midbrain dopamine neurons encode a quantitative reward prediction error signal.
Bayer HM, Glimcher PW. Bayer HM, et al. Neuron. 2005 Jul 7;47(1):129-41. doi: 10.1016/j.neuron.2005.05.020. Neuron. 2005. PMID: 15996553 Free PMC article. - Importance of unpredictability for reward responses in primate dopamine neurons.
Mirenowicz J, Schultz W. Mirenowicz J, et al. J Neurophysiol. 1994 Aug;72(2):1024-7. doi: 10.1152/jn.1994.72.2.1024. J Neurophysiol. 1994. PMID: 7983508 - Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task.
Schultz W, Apicella P, Ljungberg T. Schultz W, et al. J Neurosci. 1993 Mar;13(3):900-13. doi: 10.1523/JNEUROSCI.13-03-00900.1993. J Neurosci. 1993. PMID: 8441015 Free PMC article. - Generating bursts (and pauses) in the dopamine midbrain neurons.
Paladini CA, Roeper J. Paladini CA, et al. Neuroscience. 2014 Dec 12;282:109-21. doi: 10.1016/j.neuroscience.2014.07.032. Epub 2014 Jul 27. Neuroscience. 2014. PMID: 25073045 Review. - Reward prediction error computation in the pedunculopontine tegmental nucleus neurons.
Kobayashi Y, Okada K. Kobayashi Y, et al. Ann N Y Acad Sci. 2007 May;1104:310-23. doi: 10.1196/annals.1390.003. Epub 2007 Mar 7. Ann N Y Acad Sci. 2007. PMID: 17344541 Review.
Cited by
- Computational models of reinforcement learning: the role of dopamine as a reward signal.
Samson RD, Frank MJ, Fellous JM. Samson RD, et al. Cogn Neurodyn. 2010 Jun;4(2):91-105. doi: 10.1007/s11571-010-9109-x. Epub 2010 Mar 21. Cogn Neurodyn. 2010. PMID: 21629583 Free PMC article. - Microstimulation of the human substantia nigra alters reinforcement learning.
Ramayya AG, Misra A, Baltuch GH, Kahana MJ. Ramayya AG, et al. J Neurosci. 2014 May 14;34(20):6887-95. doi: 10.1523/JNEUROSCI.5445-13.2014. J Neurosci. 2014. PMID: 24828643 Free PMC article. - Dopamine neurons encode performance error in singing birds.
Gadagkar V, Puzerey PA, Chen R, Baird-Daniel E, Farhang AR, Goldberg JH. Gadagkar V, et al. Science. 2016 Dec 9;354(6317):1278-1282. doi: 10.1126/science.aah6837. Epub 2016 Dec 8. Science. 2016. PMID: 27940871 Free PMC article. - A Biologically Inspired Computational Model of Basal Ganglia in Action Selection.
Baston C, Ursino M. Baston C, et al. Comput Intell Neurosci. 2015;2015:187417. doi: 10.1155/2015/187417. Epub 2015 Nov 10. Comput Intell Neurosci. 2015. PMID: 26640481 Free PMC article. - Dissociable responses to punishment in distinct striatal regions during reversal learning.
Robinson OJ, Frank MJ, Sahakian BJ, Cools R. Robinson OJ, et al. Neuroimage. 2010 Jul 15;51(4):1459-67. doi: 10.1016/j.neuroimage.2010.03.036. Epub 2010 Mar 18. Neuroimage. 2010. PMID: 20303408 Free PMC article.
Publication types
MeSH terms
Substances
LinkOut - more resources
Full Text Sources
Other Literature Sources