Temporal difference models describe higher-order learning in humans (original) (raw)
References
Sutton, R. S. & Barto, A. G. in Learning and Computational Neuroscience: Foundations of Adaptive Networks (eds Gabriel, M. & Moore, J.) 497–537 (MIT, Cambridge, Massachusetts, 1990) Google Scholar
Everitt, B. J. et al. Associative processes in addiction and reward. The role of amygdala–ventral striatal subsystems. Ann. NY Acad. Sci.877, 412–438 (1999) ArticleADSCAS Google Scholar
LeDoux, J. Fear and the brain: where have we been, and where are we going? Biol. Psychiatry44, 1229–1238 (1998) ArticleCAS Google Scholar
Buchel, C. & Dolan, R. J. Classical fear conditioning in functional neuroimaging. Curr. Opin. Neurobiol.10, 219–223 (2000) ArticleCAS Google Scholar
Ploghaus, A. et al. Dissociating pain from its anticipation in the human brain. Science284, 1979–1981 (1999) ArticleCAS Google Scholar
Ploghaus, A. et al. Learning about pain: the neural substrate of the prediction error for aversive events. Proc. Natl Acad. Sci. USA97, 9281–9286 (2000) ArticleADSCAS Google Scholar
Dickinson, A. Contemporary Animal Learning Theory (Cambridge Univ. Press, Cambridge, UK, 1980) Google Scholar
Sutton, R. S. & Barto, A. G. Toward a modern theory of adaptive networks: expectation and prediction. Psychol. Rev.88, 135–170 (1981) ArticleCAS Google Scholar
Sutton, R. S. & Barto, A. G. Reinforcement Learning: An Introduction (MIT, Cambridge, Massachusetts, 1998) Google Scholar
Montague, P. R., Dayan, P. & Sejnowski, T. J. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J. Neurosci.16, 1936–1947 (1996) ArticleCAS Google Scholar
Schultz, W., Dayan, P. & Montague, P. R. A neural substrate of prediction and reward. Science275, 1593–1599 (1997) ArticleCAS Google Scholar
Suri, R. E. & Schultz, W. Temporal difference model reproduces anticipatory neural activity. Neural Comput.13, 841–862 (2001) ArticleCAS Google Scholar
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H. & Dolan, R. J. Temporal difference models and reward-related learning in the human brain. Neuron38, 329–337 (2003) ArticleCAS Google Scholar
Friston, K. J., Tononi, G., Reeke, G. N. Jr, Sporns, O. & Edelman, G. M. Value-dependent selection in the brain: simulation in a synthetic neural model. Neuroscience59, 229–243 (1994) ArticleCAS Google Scholar
McClure, S. M., Berns, G. S. & Montague, P. R. Temporal prediction errors in a passive learning task activate human striatum. Neuron38, 339–346 (2003) ArticleCAS Google Scholar
Daw, N. D., Kakade, S. & Dayan, P. Opponent interactions between serotonin and dopamine. Neural Netw.15, 603–616 (2002) Article Google Scholar
Brandon, S. E., Vogel, E. H. & Wagner, A. R. Stimulus representation in SOP: I. Theoretical rationalization and some implications. Behav. Processes62, 5–25 (2003) Article Google Scholar
Barto, A. G., Sutton, R. S. & Anderson, C. W. Neuronlike elements that can solve difficult learning problems. IEEE Trans. Syst. Man Cybern.13, 834–846 (1983) Article Google Scholar
Barto, A. G., Sutton, R. S. & Watkins, C. J. C. H. in Learning and Computational Neuroscience: Foundations of Adaptive Networks (eds Gabriel, M. & Moor, J.) 539–602 (MIT, Cambridge, Massachusetts, 1990) Google Scholar
Barto, A. G. in Models of Information Processing in the Basal Ganglia (eds Houk, J. C., Davis, J. L. & Beiser, D. G.) 215–232 (MIT, Cambridge, Massachusetts, 1995) Google Scholar
Chudler, E. H. & Dong, W. K. The role of the basal ganglia in nociception and pain. Pain60, 3–38 (1995) ArticleCAS Google Scholar
Solomon, R. L. & Corbit, J. D. An opponent-process theory of motivation. I. Temporal dynamics of affect. Psychol. Rev.81, 119–145 (1974) ArticleCAS Google Scholar
Dickinson, A. & Dearing, M. F. in Mechanisms of Learning and Motivation (eds Dickinson, A. & Boakes, R. A.) 203–231 (Erlbaum, Hillsdale, New Jersey, 1979) Google Scholar
Horvitz, J. C. Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience96, 651–656 (2000) ArticleCAS Google Scholar
Azmitia, E. C. & Segal, M. An autoradiographic analysis of the differential ascending projections of the dorsal and median raphe nuclei in the rat. J. Comp. Neurol.179, 641–667 (1978) ArticleCAS Google Scholar
Mirenowicz, J. & Schultz, W. Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature379, 449–451 (1996) ArticleADSCAS Google Scholar
Horvitz, J. C. Dopamine gating of glutamatergic sensorimotor and incentive motivational input signals to the striatum. Behav. Brain Res.137, 65–74 (2002) ArticleCAS Google Scholar
Ploghaus, A., Becerra, L., Borras, C. & Borsook, D. Neural circuitry underlying pain modulation: expectation, hypnosis, placebo. Trends Cogn. Sci.7, 197–200 (2003) Article Google Scholar
Deichmann, R., Gottfried, J. A., Hutton, C. & Turner, R. Optimized EPI for fMRI studies of the orbitofrontal cortex. Neuroimage19, 430–441 (2003) ArticleCAS Google Scholar
Buchel, C., Dolan, R. J., Armony, J. L. & Friston, K. J. Amygdala–hippocampal involvement in human aversive trace conditioning revealed through event-related functional magnetic resonance imaging. J. Neurosci.19, 10869–10876 (1999) ArticleCAS Google Scholar