What Learning Systems do Intelligent Agents Need? Complementary Learning Systems Theory Updated - PubMed (original) (raw)
Review
What Learning Systems do Intelligent Agents Need? Complementary Learning Systems Theory Updated
Dharshan Kumaran et al. Trends Cogn Sci. 2016 Jul.
Abstract
We update complementary learning systems (CLS) theory, which holds that intelligent agents must possess two learning systems, instantiated in mammalians in neocortex and hippocampus. The first gradually acquires structured knowledge representations while the second quickly learns the specifics of individual experiences. We broaden the role of replay of hippocampal memories in the theory, noting that replay allows goal-dependent weighting of experience statistics. We also address recent challenges to the theory and extend it by showing that recurrent activation of hippocampal traces can support some forms of generalization and that neocortical learning can be rapid for information that is consistent with known structure. Finally, we note the relevance of the theory to the design of artificial intelligent agents, highlighting connections between neuroscience and machine learning.
Keywords: artificial intelligence; hippocampus; learning; memory.
Copyright © 2016 Elsevier Ltd. All rights reserved.
Similar articles
- Incorporating rapid neocortical learning of new schema-consistent information into complementary learning systems theory.
McClelland JL. McClelland JL. J Exp Psychol Gen. 2013 Nov;142(4):1190-1210. doi: 10.1037/a0033812. Epub 2013 Aug 26. J Exp Psychol Gen. 2013. PMID: 23978185 Review. - Off-line replay maintains declarative memories in a model of hippocampal-neocortical interactions.
Káli S, Dayan P. Káli S, et al. Nat Neurosci. 2004 Mar;7(3):286-94. doi: 10.1038/nn1202. Epub 2004 Feb 22. Nat Neurosci. 2004. PMID: 14983183 - Complementary learning systems.
O'Reilly RC, Bhattacharyya R, Howard MD, Ketz N. O'Reilly RC, et al. Cogn Sci. 2014 Aug;38(6):1229-48. doi: 10.1111/j.1551-6709.2011.01214.x. Epub 2011 Dec 5. Cogn Sci. 2014. PMID: 22141588 Review. - A coupled neural field model for the standard consolidation theory.
Blum Moyse L, Berry H. Blum Moyse L, et al. J Theor Biol. 2024 Jul 7;588:111818. doi: 10.1016/j.jtbi.2024.111818. Epub 2024 Apr 15. J Theor Biol. 2024. PMID: 38621583 - Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory.
McClelland JL, McNaughton BL, O'Reilly RC. McClelland JL, et al. Psychol Rev. 1995 Jul;102(3):419-457. doi: 10.1037/0033-295X.102.3.419. Psychol Rev. 1995. PMID: 7624455 Review.
Cited by
- Variable specificity of memory trace reactivation during hippocampal sharp wave ripples.
Swanson RA, Levenstein D, McClain K, Tingley D, Buzsáki G. Swanson RA, et al. Curr Opin Behav Sci. 2020 Apr;32:126-135. doi: 10.1016/j.cobeha.2020.02.008. Epub 2020 Apr 2. Curr Opin Behav Sci. 2020. PMID: 36034494 Free PMC article. - Self-Net: Lifelong Learning via Continual Self-Modeling.
Mandivarapu JK, Camp B, Estrada R. Mandivarapu JK, et al. Front Artif Intell. 2020 Apr 9;3:19. doi: 10.3389/frai.2020.00019. eCollection 2020. Front Artif Intell. 2020. PMID: 33733138 Free PMC article. - Toward an Integration of Deep Learning and Neuroscience.
Marblestone AH, Wayne G, Kording KP. Marblestone AH, et al. Front Comput Neurosci. 2016 Sep 14;10:94. doi: 10.3389/fncom.2016.00094. eCollection 2016. Front Comput Neurosci. 2016. PMID: 27683554 Free PMC article. - Formation and retrieval of cell assemblies in a biologically realistic spiking neural network model of area CA3 in the mouse hippocampus.
Kopsick JD, Kilgore JA, Adam GC, Ascoli GA. Kopsick JD, et al. J Comput Neurosci. 2024 Nov;52(4):303-321. doi: 10.1007/s10827-024-00881-3. Epub 2024 Sep 17. J Comput Neurosci. 2024. PMID: 39285088 Free PMC article. - Dose-Dependent Effects of Closed-Loop tACS Delivered During Slow-Wave Oscillations on Memory Consolidation.
Jones AP, Choe J, Bryant NB, Robinson CSH, Ketz NA, Skorheim SW, Combs A, Lamphere ML, Robert B, Gill HA, Heinrich MD, Howard MD, Clark VP, Pilly PK. Jones AP, et al. Front Neurosci. 2018 Nov 27;12:867. doi: 10.3389/fnins.2018.00867. eCollection 2018. Front Neurosci. 2018. PMID: 30538617 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources