What Learning Systems do Intelligent Agents Need? Complementary Learning Systems Theory Updated - PubMed (original) (raw)
Review
What Learning Systems do Intelligent Agents Need? Complementary Learning Systems Theory Updated
Dharshan Kumaran et al. Trends Cogn Sci. 2016 Jul.
Abstract
We update complementary learning systems (CLS) theory, which holds that intelligent agents must possess two learning systems, instantiated in mammalians in neocortex and hippocampus. The first gradually acquires structured knowledge representations while the second quickly learns the specifics of individual experiences. We broaden the role of replay of hippocampal memories in the theory, noting that replay allows goal-dependent weighting of experience statistics. We also address recent challenges to the theory and extend it by showing that recurrent activation of hippocampal traces can support some forms of generalization and that neocortical learning can be rapid for information that is consistent with known structure. Finally, we note the relevance of the theory to the design of artificial intelligent agents, highlighting connections between neuroscience and machine learning.
Keywords: artificial intelligence; hippocampus; learning; memory.
Copyright © 2016 Elsevier Ltd. All rights reserved.
Similar articles
- Incorporating rapid neocortical learning of new schema-consistent information into complementary learning systems theory.
McClelland JL. McClelland JL. J Exp Psychol Gen. 2013 Nov;142(4):1190-1210. doi: 10.1037/a0033812. Epub 2013 Aug 26. J Exp Psychol Gen. 2013. PMID: 23978185 Review. - Off-line replay maintains declarative memories in a model of hippocampal-neocortical interactions.
Káli S, Dayan P. Káli S, et al. Nat Neurosci. 2004 Mar;7(3):286-94. doi: 10.1038/nn1202. Epub 2004 Feb 22. Nat Neurosci. 2004. PMID: 14983183 - Complementary learning systems.
O'Reilly RC, Bhattacharyya R, Howard MD, Ketz N. O'Reilly RC, et al. Cogn Sci. 2014 Aug;38(6):1229-48. doi: 10.1111/j.1551-6709.2011.01214.x. Epub 2011 Dec 5. Cogn Sci. 2014. PMID: 22141588 Review. - A coupled neural field model for the standard consolidation theory.
Blum Moyse L, Berry H. Blum Moyse L, et al. J Theor Biol. 2024 Jul 7;588:111818. doi: 10.1016/j.jtbi.2024.111818. Epub 2024 Apr 15. J Theor Biol. 2024. PMID: 38621583 - Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory.
McClelland JL, McNaughton BL, O'Reilly RC. McClelland JL, et al. Psychol Rev. 1995 Jul;102(3):419-457. doi: 10.1037/0033-295X.102.3.419. Psychol Rev. 1995. PMID: 7624455 Review.
Cited by
- Identifying Transfer Learning in the Reshaping of Inductive Biases.
Székely A, Török B, Kiss M, Janacsek K, Németh D, Orbán G. Székely A, et al. Open Mind (Camb). 2024 Sep 15;8:1107-1128. doi: 10.1162/opmi_a_00158. eCollection 2024. Open Mind (Camb). 2024. PMID: 39296349 Free PMC article. - Expanding continual few-shot learning benchmarks to include recognition of specific instances.
Kowadlo G, Ahmed A, Mayan A, Rawlinson D. Kowadlo G, et al. PLoS One. 2024 Jul 5;19(7):e0305856. doi: 10.1371/journal.pone.0305856. eCollection 2024. PLoS One. 2024. PMID: 38968250 Free PMC article. - Representational integration and differentiation in the human hippocampus following goal-directed navigation.
Fernandez C, Jiang J, Wang SF, Choi HL, Wagner AD. Fernandez C, et al. Elife. 2023 Feb 14;12:e80281. doi: 10.7554/eLife.80281. Elife. 2023. PMID: 36786678 Free PMC article. - Sleep-Dependent Memory Consolidation and Incremental Sentence Comprehension: Computational Dependencies during Language Learning as Revealed by Neuronal Oscillations.
Cross ZR, Kohler MJ, Schlesewsky M, Gaskell MG, Bornkessel-Schlesewsky I. Cross ZR, et al. Front Hum Neurosci. 2018 Jan 31;12:18. doi: 10.3389/fnhum.2018.00018. eCollection 2018. Front Hum Neurosci. 2018. PMID: 29445333 Free PMC article. - Emergent neural dynamics and geometry for generalization in a transitive inference task.
Kay K, Biderman N, Khajeh R, Beiran M, Cueva CJ, Shohamy D, Jensen G, Wei XX, Ferrera VP, Abbott LF. Kay K, et al. PLoS Comput Biol. 2024 Apr 25;20(4):e1011954. doi: 10.1371/journal.pcbi.1011954. eCollection 2024 Apr. PLoS Comput Biol. 2024. PMID: 38662797 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources