Neural mechanisms of acquired phasic dopamine responses in learning.

Neuroscience and Biobehavioral Reviews
Thomas E HazyRandall C O'Reilly

Abstract

What biological mechanisms underlie the reward-predictive firing properties of midbrain dopaminergic neurons, and how do they relate to the complex constellation of empirical findings understood as Pavlovian and instrumental conditioning? We previously presented PVLV, a biologically inspired Pavlovian learning algorithm accounting for DA activity in terms of two interrelated systems: a primary value (PV) system, which governs how DA cells respond to a US (reward) and; a learned value (LV) system, which governs how DA cells respond to a CS. Here, we provide a more extensive review of the biological mechanisms supporting phasic DA firing and their relation to the spate of Pavlovian conditioning phenomena and their sensitivity to focal brain lesions. We further extend the model by incorporating a new NV (novelty value) component reflecting the ability of novel stimuli to trigger phasic DA firing, providing "novelty bonuses" which encourages exploratory working memory updating and in turn speeds learning in trace conditioning and other working memory-dependent paradigms. The evolving PVLV model builds upon insights developed in many earlier computational models, especially reinforcement learning models based on the ideas of Sutton ...Continue Reading

References

Mar 1, 1979·Experimental Neurology·M K SangheraA Roper-Hall
Mar 1, 1976·The Journal of Comparative Neurology·R Norgren
Apr 1, 1971·Electroencephalography and Clinical Neurophysiology·J M Fuster, A A Uyeda
Mar 1, 1969·Experimental Neurology·J O'Keefe, H Bouma
May 1, 1994·Trends in Neurosciences·M DavisM Cassell
Mar 28, 1995·Proceedings of the National Academy of Sciences of the United States of America·Y Y Huang, E R Kandel
Dec 6, 1994·Proceedings of the National Academy of Sciences of the United States of America·M Gallagher, P C Holland
Jul 1, 1995·Progress in Neurobiology·T OnoT Uwano
Mar 14, 1997·Science·W SchultzP R Montague
Jun 10, 1998·Neurobiology of Learning and Memory·M A Kronforst-Collins, J F Disterhoft
Oct 1, 1998·Neurobiology of Learning and Memory·A M Graybiel
Apr 24, 1999·Trends in Neurosciences·P RedgraveK Gurney
Jun 9, 2000·Annual Review of Neuroscience·W Schultz, A Dickinson
Mar 20, 2001·Neural Computation·R E Suri, W Schultz
Dec 26, 2001·Brain Research. Brain Research Reviews·G D PetrovichL W Swanson
May 30, 2002·Neuroscience and Biobehavioral Reviews·Rudolf N CardinalBarry J Everitt
Jul 3, 2002·Nature Reviews. Neuroscience·Mark G Baxter, Elisabeth A Murray
Oct 10, 2002·Neural Networks : the Official Journal of the International Neural Network Society·Kenji Doya
Dec 7, 2002·Cognitive, Affective & Behavioral Neuroscience·M J FrankR C O'Reilly
Jan 23, 2003·Proceedings of the National Academy of Sciences of the United States of America·Shaowen BaoMichael M Merzenich
Mar 4, 2003·Journal of Neurophysiology·Howard C Cromwell, Wolfram Schultz
Jan 1, 1963·Annual Review of Physiology·E N SOKOLOV
Mar 17, 2004·Neuroscience and Biobehavioral Reviews·Sam A DeadwylerRobert E Hampson
Apr 28, 2004·Neural Networks : the Official Journal of the International Neural Network Society·Joshua W BrownStephen Grossberg

❮ Previous
Next ❯

Citations

Jul 16, 2010·Neuropsychopharmacology : Official Publication of the American College of Neuropsychopharmacology·Michael J Frank, John A Fossella
May 3, 2012·Neuropsychopharmacology : Official Publication of the American College of Neuropsychopharmacology·Guido K W FrankRandall C O'Reilly
Oct 25, 2012·Translational Psychiatry·S J MoellerR Z Goldstein
May 14, 2011·Journal of Cognitive Neuroscience·Christopher H ChathamNaomi P Friedman
Feb 7, 2013·Journal of Cognitive Neuroscience·Tsung-Ren HuangRandall C O'Reilly
Sep 23, 2010·Neural Computation·Hiroyuki Nakahara, Sivaramakrishnan Kaveri
Oct 2, 2012·Neural Computation·Michael J O'Brien, Narayan Srinivasa
Jan 14, 2012·PLoS Computational Biology·Karl J FristonSven Bestmann
Aug 13, 2013·Computational Intelligence and Neuroscience·Seth A HerdRandall C O'Reilly
May 15, 2012·Biological Psychiatry·Brooks King-Casas, Pearl H Chiu
Dec 20, 2011·Trends in Neurosciences·Andre Der-Avakian, Athina Markou
Jul 2, 2011·Biological Psychiatry·Guido K W FrankRandall C O'Reilly
Apr 11, 2012·The European Journal of Neuroscience·Mayank AggarwalJeffery R Wickens
Apr 23, 2015·Human Psychopharmacology·Leanne ShellshearDavid A Copland
Sep 1, 2015·Nature·Neir EshelNaoshige Uchida
Aug 22, 2013·Behavioural Processes·Kimberly Kirkpatrick
Mar 19, 2015·Frontiers in Behavioral Neuroscience·Sven Hoffmann, Christian Beste
Jan 28, 2014·Current Opinion in Neurobiology·Hiroyuki Nakahara
May 6, 2014·Neuropsychologia·Seth A HerdNaomi P Friedman
May 28, 2013·Computational Intelligence and Neuroscience·Yanlong Sun, Hongbin Wang
Apr 18, 2018·Scientific Data·Wolfgang M PauliJ Michael Tyszka
Sep 2, 2016·Journal of Neurophysiology·Carmen C CanavierBoris S Gutkin
Nov 13, 2019·The Clinical Journal of Pain·Daniel S HarvieMichele Sterling
Jul 22, 2017·Frontiers in Systems Neuroscience·Susan M Tyree, Luis de Lecea
Oct 14, 2017·Scientific Reports·Anthony J AngwinDavid A Copland
Nov 13, 2018·Personality Neuroscience·Stephen J ReadLynn C Miller
Apr 26, 2017·Annual Review of Neuroscience·Mitsuko Watabe-UchidaNaoshige Uchida
Dec 21, 2016·Frontiers in Neuroscience·Pieter-Jan MaesMarc Leman
Oct 25, 2020·Addiction Biology·Zhenhao ShiDaniel D Langleben
Jan 8, 2021·Cognitive, Affective & Behavioral Neuroscience·Seth HerdRandall O'Reilly
May 12, 2020·Trends in Cognitive Sciences·Randall C O'Reilly
Jun 22, 2021·Computational Brain & Behavior·Jeffrey B InglisF Gregory Ashby

❮ Previous
Next ❯

Related Concepts

Related Feeds

Basal Ganglia

Basal Ganglia are a group of subcortical nuclei in the brain associated with control of voluntary motor movements, procedural and habit learning, emotion, and cognition. Here is the latest research.

Barrel cortex

Here is the latest research on barrel cortex, a region of somatosensory and motor corticies in the brain, which are used by animals that rely on whiskers for world exploration.

Amygdala: Sensory Processes

Amygdalae, nuclei clusters located in the temporal lobe of the brain, play a role in memory, emotional responses, and decision-making. Here is the latest research on sensory processes in the amygdala.

Amygdala and Midbrain Dopamine

The midbrain dopamine system is widely studied for its involvement in emotional and motivational behavior. Some of these neurons receive information from the amygdala and project throughout the cortex. When the circuit and transmission of dopamine is disrupted symptoms may present. Here is the latest research on the amygdala and midbrain dopamine.

Related Papers

Neural Networks : the Official Journal of the International Neural Network Society
Mark D HumphriesKevin Gurney
© 2022 Meta ULC. All rights reserved