Online evaluation of novel choices by simultaneous representation of multiple memories (original) (raw)

References

1. Wimmer, G.E. & Shohamy, D. Preference by association: how memory mechanisms in the hippocampus bias decisions. Science 338, 270–273 (2012).
   Article CAS Google Scholar
2. Peters, J. & Büchel, C. Episodic future thinking reduces reward delay discounting through an enhancement of prefrontal-mediotemporal interactions. Neuron 66, 138–148 (2010).
   Article CAS Google Scholar
3. Kumaran, D., Summerfield, J.J., Hassabis, D. & Maguire, E.A. Tracking the emergence of conceptual knowledge during human decision making. Neuron 63, 889–901 (2009).
   Article CAS Google Scholar
4. Zeithamova, D., Dominick, A.L. & Preston, A.R. Hippocampal and ventral medial prefrontal activation during retrieval-mediated learning supports novel inference. Neuron 75, 168–179 (2012).
   Article CAS Google Scholar
5. Hampton, A.N., Bossaerts, P. & O'Doherty, J.P. The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans. J. Neurosci. 26, 8360–8367 (2006).
   Article CAS Google Scholar
6. Gläscher, J., Daw, N., Dayan, P. & O'Doherty, J.P. States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 66, 585–595 (2010).
   Article Google Scholar
7. Nicolle, A. et al. An agent independent axis for executed and modeled choice in medial prefrontal cortex. Neuron 75, 1114–1121 (2012).
   Article CAS Google Scholar
8. Johnson, A. & Redish, A.D. Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point. J. Neurosci. 27, 12176–12189 (2007).
   Article CAS Google Scholar
9. Steiner, A.P. & Redish, A.D. The road not taken: neural correlates of decision making in orbitofrontal cortex. Front. Neurosci. 6, 131 (2012).
   Article Google Scholar
10. Grill-Spector, K., Henson, R. & Martin, A. Repetition and the brain: neural models of stimulus-specific effects. Trends Cogn. Sci. 10, 14–23 (2006).
    Article Google Scholar
11. Kohn, A. Visual adaptation: physiology, mechanisms and functional benefits. J. Neurophysiol. 97, 3155–3164 (2007).
    Article Google Scholar
12. Doeller, C.F., Barry, C. & Burgess, N. Evidence for grid cells in a human memory network. Nature 463, 657–661 (2010).
    Article CAS Google Scholar
13. Kourtzi, Z. & Kanwisher, N. Representation of perceived object shape by the human lateral occipital complex. Science 293, 1506–1509 (2001).
    Article CAS Google Scholar
14. Becker, G.M., DeGroot, M.H. & Marschak, J. Measuring utility by a single-response sequential method. Behav. Sci. 9, 226–232 (1964).
    Article CAS Google Scholar
15. Kable, J.W. & Glimcher, P.W. The neurobiology of decision: consensus and controversy. Neuron 63, 733–745 (2009).
    Article CAS Google Scholar
16. Boorman, E.D., Behrens, T.E.J., Woolrich, M.W. & Rushworth, M.F.S. How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 62, 733–743 (2009).
    Article CAS Google Scholar
17. Hunt, L.T. et al. Mechanisms underlying cortical activity during value-guided choice. Nat. Neurosci. 15, 470–476 (2012).
    Article CAS Google Scholar
18. Jocham, G., Hunt, L.T., Near, J. & Behrens, T.E.J. A mechanism for value-guided choice based on the excitation-inhibition balance in prefrontal cortex. Nat. Neurosci. 15, 960–961 (2012).
    Article CAS Google Scholar
19. Hassabis, D., Kumaran, D. & Maguire, E.A. Using imagination to understand the neural basis of episodic memory. J. Neurosci. 27, 14365–14374 (2007).
    Article CAS Google Scholar
20. Schacter, D.L. & Addis, D.R. Constructive memory: the ghosts of past and future. Nature 445, 27 (2007).
    Article CAS Google Scholar
21. Balleine, B.W. & Dickinson, A. Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37, 407–419 (1998).
    Article CAS Google Scholar
22. Tolman, E.C. Cognitive maps in rats and men. Psychol. Rev. 55, 189–208 (1948).
    Article CAS Google Scholar
23. Daw, N.D., Gershman, S.J., Seymour, B., Dayan, P. & Dolan, R.J. Model-based influences on humans' choices and striatal prediction errors. Neuron 69, 1204–1215 (2011).
    Article CAS Google Scholar
24. Klein-Flügge, M.C., Barron, H.C., Brodersen, K.H., Dolan, R.J. & Behrens, T.E.J. Segregated encoding of reward-identity and stimulus-reward associations in human orbitofrontal cortex. J. Neurosci. 33, 3202–3211 (2013).
    Article Google Scholar
25. Wiggs, C.L. & Martin, A. Properties and mechanisms of perceptual priming. Curr. Opin. Neurobiol. 8, 227–233 (1998).
    Article CAS Google Scholar
26. Desimone, R. Neural mechanisms for visual memory and their role in attention. Proc. Natl. Acad. Sci. USA 93, 13494–13499 (1996).
    Article CAS Google Scholar
27. Summerfield, C., Trittschuh, E.H., Monti, J.M., Mesulam, M.-M. & Egner, T. Neural repetition suppression reflects fulfilled perceptual expectations. Nat. Neurosci. 11, 1004–1006 (2008).
    Article CAS Google Scholar
28. Johnson, A., Van der Meer, M.A. & Redish, A.D. Integrating hippocampus and striatum in decision-making. Curr. Opin. Neurobiol. 17, 692–697 (2007).
    Article CAS Google Scholar
29. Jones, J.L. et al. Orbitofrontal cortex supports behavior and learning using inferred but not cached values. Science 338, 953–956 (2012).
    Article CAS Google Scholar
30. Sutton, R.S. Integrated architectures for learning, planning, and reacting based on approximating dynamic programming. Proc. 7th Int. Conf. Mach. Learn. 216, 224 (1990).
    Google Scholar
31. Johnson, A. & Redish, A.D. Hippocampal replay contributes to within session learning in a temporal difference reinforcement learning model. Neural Netw. 18, 1163–1171 (2005).
    Article Google Scholar
32. Gershman, S.J., Markman, A.B. & Otto, A.R. Retrospective revaluation in sequential decision making: a tale of two systems. J. Exp. Psychol. Gen. published online, doi:10.1037/a0030844 (10 December 2012) (2012).
33. Kable, J.W. & Glimcher, P.W. The neural correlates of subjective value during intertemporal choice. Nat. Neurosci. 10, 1625–1633 (2007).
    Article CAS Google Scholar
34. FitzGerald, T.H.B., Seymour, B. & Dolan, R.J. The role of human orbitofrontal cortex in value comparison for incommensurable objects. J. Neurosci. 29, 8388–8395 (2009).
    Article CAS Google Scholar
35. Plassmann, H., O'Doherty, J. & Rangel, A. Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. J. Neurosci. 27, 9984–9988 (2007).
    Article CAS Google Scholar
36. Levy, I., Lazzaro, S.C., Rutledge, R.B. & Glimcher, P.W. Choice from non-choice: predicting consumer preferences from blood oxygenation level–dependent signals obtained during passive viewing. J. Neurosci. 31, 118–125 (2011).
    Article CAS Google Scholar
37. Behrens, T.E.J., Hunt, L.T., Woolrich, M.W. & Rushworth, M.F.S. Associative learning of social value. Nature 456, 245–249 (2008).
    Article CAS Google Scholar
38. Janowski, V., Camerer, C. & Rangel, A. Empathic choice involves vmPFC value signals that are modulated by social processing implemented in IPL. Soc. Cogn. Affect. Neurosci. 8, 201–208 (2012).
    Article Google Scholar
39. Daw, N.D., Niv, Y. & Dayan, P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8, 1704–1711 (2005).
    Article CAS Google Scholar
40. McDannald, M.A. et al. Model-based learning and the contribution of the orbitofrontal cortex to the model-free world. Eur. J. Neurosci. 35, 991–996 (2012).
    Article Google Scholar
41. Dragoi, G. & Tonegawa, S. Preplay of future place cell sequences by hippocampal cellular assemblies. Nature 469, 397–401 (2011).
    Article CAS Google Scholar
42. Doeller, C.F. & Burgess, N. Distinct error-correcting and incidental learning of location relative to landmarks and boundaries. Proc. Natl. Acad. Sci. USA 105, 5909–5914 (2008).
    Article CAS Google Scholar
43. Hassabis, D. & Maguire, E.A. Deconstructing episodic memory with construction. Trends Cogn. Sci. 11, 299–306 (2007).
    Article Google Scholar
44. Klein, S.B., Loftus, J. & Kihlstrom, J.F. Memory and temporal experience: the effects of episodic memory loss on an amnesic patient's ability to remember the past and imagine the future. Soc. Cogn. 20, 353–379 (2002).
    Article Google Scholar
45. Buckner, R.L. The role of the hippocampus in prediction and imagination. Annu. Rev. Psychol. 61, 27–48 (2010).
    Article Google Scholar
46. Davachi, L. Item, context and relational episodic encoding in humans. Curr. Opin. Neurobiol. 16, 693–700 (2006).
    Article CAS Google Scholar
47. Rudy, J.W. & Sutherland, R.J. The hippocampal formation is necessary for rats to learn and remember configural discriminations. Behav. Brain Res. 34, 97–109 (1989).
    Article CAS Google Scholar
48. Schacter, D.L. & Addis, D.R. The cognitive neuroscience of constructive memory: remembering the past and imagining the future. Phil. Trans. R. Soc. Lond. B 362, 773–786 (2007).
    Article Google Scholar
49. Addis, D.R., Wong, A.T. & Schacter, D.L. Remembering the past and imagining the future: common and distinct neural substrates during event construction and elaboration. Neuropsychologia 45, 1363–1377 (2007).
    Article Google Scholar
50. Harris, A., Adolphs, R., Camerer, C. & Rangel, A. Dynamic construction of stimulus values in the ventromedial prefrontal cortex. PLoS ONE 6, e21074 (2011).
    Article CAS Google Scholar

Download references