Multiple Dopamine Systems: Weal and Woe of Dopamine

Cold Spring Harbor Symposia on Quantitative Biology
Mitsuko Watabe-Uchida, Naoshige Uchida

Abstract

The ability to predict future outcomes increases the fitness of the animal. Decades of research have shown that dopamine neurons broadcast reward prediction error (RPE) signals-the discrepancy between actual and predicted reward-to drive learning to predict future outcomes. Recent studies have begun to show, however, that dopamine neurons are more diverse than previously thought. In this review, we will summarize a series of our studies that have shown unique properties of dopamine neurons projecting to the posterior "tail" of the striatum (TS) in terms of anatomy, activity, and function. Specifically, TS-projecting dopamine neurons are activated by a subset of negative events including threats from a novel object, send prediction errors for external threats, and reinforce avoidance behaviors. These results indicate that there are at least two axes of dopamine-mediated reinforcement learning in the brain-one learning from canonical RPEs and another learning from threat prediction errors. We argue that the existence of multiple learning systems is an adaptive strategy that makes possible each system optimized for its own needs. The compartmental organization in the mammalian striatum resembles that of a dopamine-recipient area i...Continue Reading

References

Jan 1, 1992·Journal of Neurophysiology·T LjungbergW Schultz
Jan 10, 1983·Brain Research·G F SteinfelsB L Jacobs
Aug 1, 1994·Journal of Neurophysiology·J Mirenowicz, W Schultz
Mar 14, 1997·Science·W SchultzP R Montague
Oct 10, 2002·Neural Networks : the Official Journal of the International Neural Network Society·Sham Kakade, Peter Dayan
Dec 1, 1954·Journal of Comparative and Physiological Psychology·J OLDS, P MILNER
May 21, 2004·Nature Reviews. Neuroscience·Roy A Wise
Sep 9, 2004·Proceedings of the National Academy of Sciences of the United States of America·Jan GrimmArnon Rosenthal
Jul 6, 2005·Neuron·Hannah M Bayer, Paul W Glimcher
Aug 24, 2005·Nature Neuroscience·Edward S BoydenKarl Deisseroth
Nov 4, 2008·Nature Neuroscience·Mitchell F RoitmanRegina M Carelli
Jun 12, 2010·Journal of Neurophysiology·Ethan S Bromberg-MartinOkihide Hikosaka
Aug 11, 2010·Neuron·Ethan S Bromberg-MartinOkihide Hikosaka
Dec 15, 2010·Nature·Shelly B FlagelHuda Akil
Mar 31, 2012·Trends in Neurosciences·Mark A Ungless, Anthony A Grace
Jun 12, 2012·Neuron·Mitsuko Watabe-UchidaNaoshige Uchida
Oct 4, 2012·Brain Research·Elizabeth E Steinberg, Patricia H Janak
Oct 19, 2012·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Erik B OlesonJoseph F Cheer
Oct 30, 2012·Nature·Christopher J BurkeScott Waddell
Dec 27, 2012·Current Opinion in Neurobiology·Wolfram Schultz
Mar 29, 2013·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Philippe MaillyJean-Michel Deniau
Apr 12, 2013·Nature·Kwanghun ChungKarl Deisseroth
Apr 16, 2013·Trends in Neurosciences·Jochen Roeper
Dec 25, 2013·Frontiers in Systems Neuroscience·Carol A Seger
Jan 17, 2014·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Andrew S HartPaul E M Phillips
Jan 28, 2014·Current Opinion in Neurobiology·Hiroyuki Nakahara
Jun 21, 2014·Cell·Lisa A GunaydinKarl Deisseroth
Dec 2, 2014·Cell Reports·Jean-Francois PoulinRajeshwar B Awatramani
Dec 31, 2014·Proceedings of the National Academy of Sciences of the United States of America·Nobuhiro YamagataHiromu Tanimoto
Feb 26, 2015·ELife·Jeremiah Y CohenNaoshige Uchida
Feb 27, 2015·Nature·Volodymyr MnihDemis Hassabis
Mar 3, 2015·Current Biology : CB·Wolf HuetterothScott Waddell
Jun 16, 2015·Frontiers in Integrative Neuroscience·Joseph W BarterHenry H Yin

❮ Previous
Next ❯

Citations

Jul 31, 2019·Cold Spring Harbor Symposia on Quantitative Biology·Adam Kepecs
Feb 15, 2020·Journal of Neuroscience Research·Anne L Collins, Benjamin T Saunders
Nov 27, 2020·Current Opinion in Neurobiology·Claire Eschbach, Marta Zlatic
Jan 31, 2021·Cell and Tissue Research·K P SijuIlona C Grunwald Kadow
Jan 8, 2021·Neuropsychopharmacology : Official Publication of the American College of Neuropsychopharmacology·Wuyi WangChiang-Shan R Li
Apr 16, 2020·Neuron·Elizabeth E SteinbergRobert C Malenka
Nov 29, 2020·Cell·HyungGoo R KimNaoshige Uchida
Oct 15, 2020·Neurobiology of Learning and Memory·Andrew R Tapper, Susanna Molas
Aug 11, 2021·PLoS Computational Biology·Linnie Jiang, Ashok Litwin-Kumar

❮ Previous
Next ❯

Related Concepts

Related Feeds

Basal Ganglia

Basal Ganglia are a group of subcortical nuclei in the brain associated with control of voluntary motor movements, procedural and habit learning, emotion, and cognition. Here is the latest research.

Related Papers

The Catholic Nurse
D N Kelly
Movement Disorders : Official Journal of the Movement Disorder Society
Natalia López-González del Rey, Javier Blesa
© 2022 Meta ULC. All rights reserved