Modeling functions of striatal dopamine modulation in learning and planning

Neuroscience
R E SuriM A Arbib

Abstract

The activity of midbrain dopamine neurons is strikingly similar to the reward prediction error of temporal difference reinforcement learning models. Experimental evidence and simulation studies suggest that dopamine neuron activity serves as an effective reinforcement signal for learning of sensorimotor associations in striatal matrisomes. In the current study, we simulate dopamine neuron activity with the extended temporal difference model of Pavlovian learning and examine the influences of this signal on medium spiny neurons in striatal matrisomes. The modeled influences include transient membrane effects of dopamine D(1) receptor activation, dopamine-dependent long-term adaptations of corticostriatal transmission, and effects of dopamine on rhythmic fluctuations of the membrane potential between an elevated "up-state" and a hyperpolarized "down-state". The most dominant activity in the striatal matrisomes is assumed to elicit behaviors via projections from the basal ganglia to the thalamus and the cortex. This "standard model" performs successfully when tested for sensorimotor learning and goal-directed behavior (planning). To investigate the contributions of our model assumptions to learning and planning, we test the perfor...Continue Reading

References

Nov 1, 1992·Proceedings of the National Academy of Sciences of the United States of America·D J SurmeierS T Kitai
Jul 1, 1990·Trends in Neurosciences·A M Graybiel
Jul 1, 1990·Trends in Neurosciences·G E Alexander, M D Crutcher
Jan 1, 1990·Neuropsychologia·C W WalleschC H Lücking
Oct 1, 1989·Trends in Neurosciences·R L AlbinJ B Penney
Jan 1, 1988·Experimental Brain Research·A RutherfordG W Arbuthnott
Sep 29, 1995·Science·D M WolpertM I Jordan
Aug 1, 1995·Brain and Cognition·A E Taylor, J A Saint-Cyr
Jan 31, 1996·Neuroreport·S Hernández-LópezE Galarraga
May 1, 1996·Behavioural Brain Research·J Decety
Mar 14, 1997·Science·W SchultzP R Montague
Mar 18, 1997·Proceedings of the National Academy of Sciences of the United States of America·S Choi, D M Lovinger
Jun 6, 1998·Neural Computation·J M Fellous, C Linster
May 26, 1998·Developmental Neuroscience·C Cepeda, M S Levine
Jul 21, 1998·Annals of the New York Academy of Sciences·T W RobbinsB J Everitt
Apr 24, 1999·Trends in Neurosciences·P RedgraveK Gurney
Mar 1, 1951·Psychological Bulletin·D THISTLETHWAITE
Apr 13, 2007·Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences·J C HoukL S Simo
Nov 11, 2009·Journal of Clinical Oncology : Official Journal of the American Society of Clinical Oncology·Lisa R TreviñoMary V Relling

❮ Previous
Next ❯

Citations

Sep 1, 2005·Biological cybernetics·T Nathan Mundhenk, Laurent Itti
Jan 16, 2008·Biological cybernetics·Christoph KolodziejskiFlorentin Wörgötter
Apr 8, 2009·Cellular and Molecular Neurobiology·Edén Flores-BarreraElvira Galarraga
Jun 2, 2011·Cognitive Neurodynamics·R D SamsonJean-Marc Fellous
Apr 28, 2004·Neural Networks : the Official Journal of the International Neural Network Society·Joshua W BrownStephen Grossberg
Mar 12, 2004·Progress in Neurobiology·Izhar Bar-GadHagai Bergman
Feb 20, 2003·European Journal of Pharmacology·Jaime BarralJosé Bargas
Oct 10, 2002·Neural Networks : the Official Journal of the International Neural Network Society·Roland E Suri
Oct 10, 2002·Neural Networks : the Official Journal of the International Neural Network Society·Daphna JoelEytan Ruppin
Mar 25, 2004·Artificial Intelligence in Medicine·Vincent LabatutPierre Celsis
Aug 2, 2002·Neuroreport·Yuri P IvanenkoFrancesco Lacquaniti
Sep 22, 2006·American Journal of Therapeutics·Sheng Chen, Weidong Le
Apr 13, 2007·Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences·Thomas E HazyRandall C O'reilly
Dec 14, 2011·Genes, Brain, and Behavior·Y-C ChenW-S Lai
May 19, 2011·PLoS Computational Biology·Wiebke PotjansAbigail Morrison
Nov 10, 2009·Cognitive, Affective & Behavioral Neuroscience·Stephen B R E Brown, K Richard Ridderinkhof
Feb 27, 2004·The European Journal of Neuroscience·Peter J Brasted, Steven P Wise
Apr 15, 2006·Network : Computation in Neural Systems·Andrew SmithShitij Kapur
Aug 9, 2008·Neuropsychologia·Ahmed A MoustafaMichael J Frank
Feb 24, 2015·Nature Reviews. Neuroscience·Saïd KourrichAntonello Bonci
Jun 28, 2011·Research in Developmental Disabilities·Michael E May
Nov 26, 2015·Journal of Psychopharmacology·Mauricio Rangel-Gomez, Martijn Meeter
Oct 25, 2017·Journal of Computational Neuroscience·Armin Salimi-BadrChristian Darlot
Mar 5, 2004·Neuropsychopharmacology : Official Publication of the American College of Neuropsychopharmacology·Andrew SmithShitij Kapur
Apr 28, 2020·The Neuroscientist : a Review Journal Bringing Neurobiology, Neurology and Psychiatry·Kelly M J Diederen, Paul C Fletcher
Dec 29, 2005·Neuroscience and Behavioral Physiology·K B Shapovalova
Feb 12, 2008·Neuroscience and Behavioral Physiology·I A SmirnitskayaG Kh Merzhanova
May 19, 2016·Journal of Biomolecular Structure & Dynamics·Wei XieSi-Chuan Xu

❮ Previous
Next ❯

Related Concepts

Related Feeds

Amygdala and Midbrain Dopamine

The midbrain dopamine system is widely studied for its involvement in emotional and motivational behavior. Some of these neurons receive information from the amygdala and project throughout the cortex. When the circuit and transmission of dopamine is disrupted symptoms may present. Here is the latest research on the amygdala and midbrain dopamine.

Basal Ganglia

Basal Ganglia are a group of subcortical nuclei in the brain associated with control of voluntary motor movements, procedural and habit learning, emotion, and cognition. Here is the latest research.