Parallel cortico-basal ganglia mechanisms for acquisition and execution of visuomotor sequences - a computational approach - PubMed (original) (raw)
Parallel cortico-basal ganglia mechanisms for acquisition and execution of visuomotor sequences - a computational approach
H Nakahara et al. J Cogn Neurosci. 2001.
Abstract
Experimental studies have suggested that many brain areas, including the basal ganglia (BG), contribute to procedural learning. Focusing on the basal ganglia-thalamocortical (BG-TC) system, we propose a computational model to explain how different brain areas work together in procedural learning. The BG-TC system is composed of multiple separate loop circuits. According to our model, two separate BG-TC loops learn a visuomotor sequence concurrently but using different coordinates, one visual, and the other motor. The visual loop includes the dorsolateral prefrontal (DLPF) cortex and the anterior part of the BG, while the motor loop includes the supplementary motor area (SMA) and the posterior BG. The concurrent learning in these loops is based on reinforcement signals carried by dopaminergic (DA) neurons that project divergently to the anterior ("visual") and posterior ("motor") parts of the striatum. It is expected, however, that the visual loop learns a sequence faster than the motor loop due to their different coordinates. The difference in learning speed may lead to inconsistent outputs from the visual and motor loops, and this problem is solved by a mechanism called a "coordinator," which adjusts the contribution of the visual and motor loops to a final motor output. The coordinator is assumed to be in the presupplementary motor area (pre-SMA). We hypothesize that the visual and motor loops, with the help of the coordinator, achieve both the quick acquisition of novel sequences and the robust execution of well-learned sequences. A computational model based on the hypothesis is examined in a series of computer simulations, referring to the results of the 2 x 5 task experiments that have been used on both monkeys and humans. We found that the dual mechanism with the coordinator was superior to the single (visual or motor) mechanism. The model replicated the following essential features of the experimental results: (1) the time course of learning, (2) the effect of opposite hand use, (3) the effect of sequence reversal, and (4) the effects of localized brain inactivations. Our model may account for a common feature of procedural learning: A spatial sequence of discrete actions (subserved by the visual loop) is gradually replaced by a robust motor skill (subserved by the motor loop).
Similar articles
- A spiking neuron model of the cortico-basal ganglia circuits for goal-directed and habitual action learning.
Chersi F, Mirolli M, Pezzulo G, Baldassarre G. Chersi F, et al. Neural Netw. 2013 May;41:212-24. doi: 10.1016/j.neunet.2012.11.009. Epub 2012 Dec 5. Neural Netw. 2013. PMID: 23266482 - Reward-dependent learning in neuronal networks for planning and decision making.
Dehaene S, Changeux JP. Dehaene S, et al. Prog Brain Res. 2000;126:217-29. doi: 10.1016/S0079-6123(00)26016-0. Prog Brain Res. 2000. PMID: 11105649 Review. - [Cortico-basal ganglia circuits--parallel closed loops and convergent/divergent connections].
Miyachi S. Miyachi S. Brain Nerve. 2009 Apr;61(4):351-9. Brain Nerve. 2009. PMID: 19378804 Review. Japanese. - Working memory and response selection: a computational account of interactions among cortico-basalganglio-thalamic loops.
Schroll H, Vitay J, Hamker FH. Schroll H, et al. Neural Netw. 2012 Feb;26:59-74. doi: 10.1016/j.neunet.2011.10.008. Epub 2011 Oct 25. Neural Netw. 2012. PMID: 22075035 - [Neuronal linkage of the cerebral cortex and the striatum].
Takada M. Takada M. Brain Nerve. 2012 Aug;64(8):871-9. Brain Nerve. 2012. PMID: 22868878 Japanese.
Cited by
- Learning to represent reward structure: a key to adapting to complex environments.
Nakahara H, Hikosaka O. Nakahara H, et al. Neurosci Res. 2012 Dec;74(3-4):177-83. doi: 10.1016/j.neures.2012.09.007. Epub 2012 Oct 13. Neurosci Res. 2012. PMID: 23069349 Free PMC article. - The importance of different learning stages for motor sequence learning after stroke.
Dahms C, Brodoehl S, Witte OW, Klingner CM. Dahms C, et al. Hum Brain Mapp. 2020 Jan;41(1):270-286. doi: 10.1002/hbm.24793. Epub 2019 Sep 14. Hum Brain Mapp. 2020. PMID: 31520506 Free PMC article. Review. - White matter microstructural correlates of superior long-term skill gained implicitly under randomized practice.
Song S, Sharma N, Buch ER, Cohen LG. Song S, et al. Cereb Cortex. 2012 Jul;22(7):1671-7. doi: 10.1093/cercor/bhr247. Epub 2011 Sep 12. Cereb Cortex. 2012. PMID: 21914632 Free PMC article. Clinical Trial. - The many facets of motor learning and their relevance for Parkinson's disease.
Marinelli L, Quartarone A, Hallett M, Frazzitta G, Ghilardi MF. Marinelli L, et al. Clin Neurophysiol. 2017 Jul;128(7):1127-1141. doi: 10.1016/j.clinph.2017.03.042. Epub 2017 Apr 9. Clin Neurophysiol. 2017. PMID: 28511125 Free PMC article. Review. - Model-based action planning involves cortico-cerebellar and basal ganglia networks.
Fermin AS, Yoshida T, Yoshimoto J, Ito M, Tanaka SC, Doya K. Fermin AS, et al. Sci Rep. 2016 Aug 19;6:31378. doi: 10.1038/srep31378. Sci Rep. 2016. PMID: 27539554 Free PMC article.
Publication types
MeSH terms
Substances
LinkOut - more resources
Full Text Sources