On the role of subsecond dopamine release in conditioned avoidance - PubMed (original) (raw)
On the role of subsecond dopamine release in conditioned avoidance
Erik B Oleson et al. Front Neurosci. 2013.
Abstract
Using shock avoidance procedures to study conditioned behavioral responses has a rich history within the field of experimental psychology. Such experiments led to the formulation of the general concept of negative reinforcement and specific theories attempting to explain escape and avoidance behavior, or why animals choose to either terminate or prevent the presentation of an aversive event. For example, the two-factor theory of avoidance holds that cues preceding an aversive event begin to evoke conditioned fear responses, and these conditioned fear responses reinforce the instrumental avoidance response. Current neuroscientific advances are providing new perspectives into this historical literature. Due to its well-established role in reinforcement processes and behavioral control, the mesolimbic dopamine system presented itself as a logical starting point in the search for neural correlates of avoidance and escape behavior. We recently demonstrated that phasic dopamine release events are inhibited by stimuli associated with aversive events but increased by stimuli preceding the successful avoidance of the aversive event. The latter observation is inconsistent with the second component of the two-factor theory of avoidance and; therefore, led us propose a new theoretical explanation of conditioned avoidance: (1) fear is initially conditioned to the warning signal and dopamine computes this fear association as a decrease in release, (2) the warning signal, now capable of producing a negative emotional state, suppresses dopamine release and behavior, (3) over repeated trials the warning signal becomes associated with safety rather than fear; dopaminergic neurons already compute safety as an increase in release and begin to encode the warning signal as the earliest predictor of safety (4) the warning signal now promotes conditioned avoidance via dopaminergic modulation of the brain's incentive-motivational circuitry.
Keywords: conditioned avoidance; dopamine; fear conditioning; nucleus accumbens; voltammetry.
Figures
Figure 1
Illustration of the first conditioned avoidance (initially described as a conditioned reflex) experiment conducted in America by John B Watson. Electrodes were placed under the hand and finger of a human subject. An auditory stimulus was presented prior to the delivery of electrical shock. A recording device allowed for the detection of finger movements evoked by the shock and the preceding auditory stimulus. Within a few trials, finger withdrawal began to occur to the auditory stimulus. The conditioned finger withdrawal broke the circuit between the two electrodes, which was necessary for the delivery of electric shock. Originally published in Watson (1916).
Figure 2
The role of subsecond dopamine release during conditioned avoidance. (A) Changes in subsecond dopamine release observed in different response types observed in a single session. Representative color plots (left) and dopamine concentration traces (right) show avoidance (top), one-footshock escape (middle), and two-footshock escape (bottom) responses. Left, the y_-axis represents the scan potential (E_pp, V) applied to the electrode, the _x_-axis represents time, and the _z_-axis represents current. Inspection of the color plot allows for the identification of dopamine over time. Dopamine can be identified in the color plot by assessing for changes in current at the oxidation (+0.6V) and reduction (−0.2V) potentials for dopamine. Right, representative dopamine concentration traces plotted as a function of time with the inset showing the cyclic voltammograms for dopamine. Arrows indicate lever responses, lightning bolts indicate footshocks, trumpets indicate safety periods, levers + lights indicate warning signals. (B,C) Mean ± SEM dopamine concentration traces from all avoidance and escape responses. Maximal warning signal duration is representative by the light gray fill, subsequent safety periods are represented by the dark gray fill. (D) Maximal dopamine concentration evoked by warning signal presentation predicts conditioned avoidance. Originally published in Oleson et al. (2012).
Figure 3
Fear-conditioned stimuli freeze behavior and subsecond dopamine release events. (A,B) An otherwise neutral stimulus (trumpet) previously conditioned to inescapable footshock (lightning bolt) produces freezing behavior that extinguishes across repeated trials of conditioned stimulus (CS) presentation on fear-memory retrieval day. (C) Representative color plot (left) and corresponding dopamine concentration trace (right) show a CS-induced decrease in dopamine release. Gray represents CS duration. (D) Mean ± SEM dopamine concentration trace during presentations of the fear-conditioned CS. Originally published in Oleson et al. (2012).
Similar articles
- Subsecond dopamine release in the nucleus accumbens predicts conditioned punishment and its successful avoidance.
Oleson EB, Gentry RN, Chioma VC, Cheer JF. Oleson EB, et al. J Neurosci. 2012 Oct 17;32(42):14804-8. doi: 10.1523/JNEUROSCI.3087-12.2012. J Neurosci. 2012. PMID: 23077064 Free PMC article. - Phasic Dopamine Signals in the Nucleus Accumbens that Cause Active Avoidance Require Endocannabinoid Mobilization in the Midbrain.
Wenzel JM, Oleson EB, Gove WN, Cole AB, Gyawali U, Dantrassy HM, Bluett RJ, Dryanovski DI, Stuber GD, Deisseroth K, Mathur BN, Patel S, Lupica CR, Cheer JF. Wenzel JM, et al. Curr Biol. 2018 May 7;28(9):1392-1404.e5. doi: 10.1016/j.cub.2018.03.037. Epub 2018 Apr 19. Curr Biol. 2018. PMID: 29681476 Free PMC article. - Dopaminergic mechanisms in the conditioned and unconditioned fear as assessed by the two-way avoidance and light switch-off tests.
Reis FL, Masson S, de Oliveira AR, Brandão ML. Reis FL, et al. Pharmacol Biochem Behav. 2004 Oct;79(2):359-65. doi: 10.1016/j.pbb.2004.08.006. Pharmacol Biochem Behav. 2004. PMID: 15501313 - Tales from the dark side: do neuromodulators of drug withdrawal require changes in endocannabinoid tone?
Oleson EB, Cachope R, Fitoussi A, Cheer JF. Oleson EB, et al. Prog Neuropsychopharmacol Biol Psychiatry. 2014 Jul 3;52:17-23. doi: 10.1016/j.pnpbp.2013.07.019. Epub 2013 Aug 1. Prog Neuropsychopharmacol Biol Psychiatry. 2014. PMID: 23911441 Free PMC article. Review. - The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking.
Ikemoto S, Panksepp J. Ikemoto S, et al. Brain Res Brain Res Rev. 1999 Dec;31(1):6-41. doi: 10.1016/s0165-0173(99)00023-5. Brain Res Brain Res Rev. 1999. PMID: 10611493 Review.
Cited by
- A kinder, gentler dopamine… highlighting dopamine's role in behavioral flexibility.
Beeler JA, Cools R, Luciana M, Ostlund SB, Petzinger G. Beeler JA, et al. Front Neurosci. 2014 Jan 24;8:4. doi: 10.3389/fnins.2014.00004. eCollection 2014. Front Neurosci. 2014. PMID: 24478624 Free PMC article. No abstract available. - Analysis of memory modulation by conditioned stimuli.
Lapointe T, Wolter M, Leri F. Lapointe T, et al. Learn Mem. 2021 Feb 16;28(3):87-94. doi: 10.1101/lm.052407.120. Print 2021 Mar. Learn Mem. 2021. PMID: 33593927 Free PMC article. - A reinforcement-learning model of active avoidance behavior: Differences between Sprague Dawley and Wistar-Kyoto rats.
Spiegler KM, Palmieri J, Pang KCH, Myers CE. Spiegler KM, et al. Behav Brain Res. 2020 Sep 1;393:112784. doi: 10.1016/j.bbr.2020.112784. Epub 2020 Jun 22. Behav Brain Res. 2020. PMID: 32585299 Free PMC article. - The power of price compels you: Behavioral economic insights into dopamine-based valuation of rewarding and aversively motivated behavior.
Oleson EB, Roberts JB. Oleson EB, et al. Brain Res. 2019 Jun 15;1713:32-41. doi: 10.1016/j.brainres.2018.11.043. Epub 2018 Dec 11. Brain Res. 2019. PMID: 30543771 Free PMC article. Review. - Norepinephrine and dopamine transmission in 2 limbic regions differentially respond to acute noxious stimulation.
Park J, Bucher ES, Budygin EA, Wightman RM. Park J, et al. Pain. 2015 Feb;156(2):318-327. doi: 10.1097/01.j.pain.0000460312.79195.ed. Pain. 2015. PMID: 25599453 Free PMC article.
References
- Arnt J. (1982). Pharmacological specificity of conditioned avoidance response inhibition in rats: inhibition by neuroleptics and correlation to dopamine receptor blockade. Acta Pharmacol. Toxicol. 51, 321–329 - PubMed
- Badrinarayan A., Wescott S. A., Vander Weele C. M., Saunders B. T., Couturier B. E., Maren S., et al. (2012). Aversive stimuli differentially modulate real-time dopamine transmission dynamics within the nucleus accumbens core and shell. J. Neurosci. 32, 15779–15790 10.1523/JNEUROSCI.3557-12.2012 - DOI - PMC - PubMed
- Bechterev V. M. (1913). The Psychologie Objective. Paris: Alcan
- Bolles R. C. (1972). The avoidance learning problem. Psychol. Learn. Motiv. Adv. Res. Theory 6, 97
LinkOut - more resources
Full Text Sources
Other Literature Sources