Learning the value of information in an uncertain world - PubMed (original) (raw)
. 2007 Sep;10(9):1214-21.
doi: 10.1038/nn1954. Epub 2007 Aug 5.
Affiliations
- PMID: 17676057
- DOI: 10.1038/nn1954
Learning the value of information in an uncertain world
Timothy E J Behrens et al. Nat Neurosci. 2007 Sep.
Abstract
Our decisions are guided by outcomes that are associated with decisions made in the past. However, the amount of influence each past outcome has on our next decision remains unclear. To ensure optimal decision-making, the weight given to decision outcomes should reflect their salience in predicting future outcomes, and this salience should be modulated by the volatility of the reward environment. We show that human subjects assess volatility in an optimal manner and adjust decision-making accordingly. This optimal estimate of volatility is reflected in the fMRI signal in the anterior cingulate cortex (ACC) when each trial outcome is observed. When a new piece of information is witnessed, activity levels reflect its salience for predicting future outcomes. Furthermore, variations in this ACC signal across the population predict variations in subject learning rates. Our results provide a formal account of how we weigh our different experiences in guiding our future actions.
Similar articles
- Value and prediction error estimation account for volatility effects in ACC: a model-based fMRI study.
Silvetti M, Seurinck R, Verguts T. Silvetti M, et al. Cortex. 2013 Jun;49(6):1627-35. doi: 10.1016/j.cortex.2012.05.008. Epub 2012 May 26. Cortex. 2013. PMID: 22717205 - Functional imaging of decision conflict.
Pochon JB, Riis J, Sanfey AG, Nystrom LE, Cohen JD. Pochon JB, et al. J Neurosci. 2008 Mar 26;28(13):3468-73. doi: 10.1523/JNEUROSCI.4195-07.2008. J Neurosci. 2008. PMID: 18367612 Free PMC article. - Optimal decision making and the anterior cingulate cortex.
Kennerley SW, Walton ME, Behrens TE, Buckley MJ, Rushworth MF. Kennerley SW, et al. Nat Neurosci. 2006 Jul;9(7):940-7. doi: 10.1038/nn1724. Epub 2006 Jun 18. Nat Neurosci. 2006. PMID: 16783368 - Choice, uncertainty and value in prefrontal and cingulate cortex.
Rushworth MF, Behrens TE. Rushworth MF, et al. Nat Neurosci. 2008 Apr;11(4):389-97. doi: 10.1038/nn2066. Epub 2008 Mar 26. Nat Neurosci. 2008. PMID: 18368045 Review. - Neurocomputational mechanisms of reinforcement-guided learning in humans: a review.
Cohen MX. Cohen MX. Cogn Affect Behav Neurosci. 2008 Jun;8(2):113-25. doi: 10.3758/cabn.8.2.113. Cogn Affect Behav Neurosci. 2008. PMID: 18589502 Review.
Cited by
- Guess what? Only correct choices forge immediate stimulus-response bindings in guessing scenarios.
Foerster A, Mocke V, Moeller B, Pfister R. Foerster A, et al. Atten Percept Psychophys. 2024 Sep 17. doi: 10.3758/s13414-024-02950-2. Online ahead of print. Atten Percept Psychophys. 2024. PMID: 39289262 - Diminished pain sensitivity mediates the relationship between psychopathic traits and reduced learning from pain.
Atanassova DV, Mathys C, Diaconescu AO, Madariaga VI, Oosterman JM, Brazil IA. Atanassova DV, et al. Commun Psychol. 2024 Sep 14;2(1):86. doi: 10.1038/s44271-024-00133-1. Commun Psychol. 2024. PMID: 39277698 Free PMC article. - Individuals with anxiety and depression use atypical decision strategies in an uncertain world.
Fang Z, Zhao M, Xu T, Li Y, Xie H, Quan P, Geng H, Zhang RY. Fang Z, et al. Elife. 2024 Sep 10;13:RP93887. doi: 10.7554/eLife.93887. Elife. 2024. PMID: 39255007 Free PMC article. - Reduced contextual uncertainty facilitates learning what to attend to and what to ignore.
Jungerius C, Perizonius S, Slagter HA. Jungerius C, et al. Atten Percept Psychophys. 2024 Aug;86(6):1861-1871. doi: 10.3758/s13414-024-02945-z. Epub 2024 Sep 10. Atten Percept Psychophys. 2024. PMID: 39254916 - Enhanced "learning to learn" through a hierarchical dual-learning system: the case of action video game players.
Gao YY, Fang Z, Zhou Q, Zhang RY. Gao YY, et al. BMC Psychol. 2024 Aug 30;12(1):460. doi: 10.1186/s40359-024-01952-x. BMC Psychol. 2024. PMID: 39215348 Free PMC article.
Publication types
MeSH terms
Substances
LinkOut - more resources
Full Text Sources
Other Literature Sources
Miscellaneous