Abstract
Prediction errors are critical for associative learning [1, 2]. Transient changes in dopamine neuron activity correlate with positive and negative reward prediction errors and can mimic their effects [3-15]. However, although causal studies show that dopamine transients of 1-2 s are sufficient to drive learning about reward, these studies do not address whether they are necessary (but see [11]). Further, the precise nature of this signal is not yet fully established. Although it has been equated with the cached-value error signal proposed to support model-free reinforcement learning, cached-value errors are typically confounded with errors in the prediction of reward features [16]. Here, we used optogenetic and transgenic approaches to prevent transient changes in midbrain dopamine neuron activity during the critical error-signaling period of two unblocking tasks. In one, learning was unblocked by increasing the number of rewards, a manipulation that induces errors in predicting both value and reward features. In another, learning was unblocked by switching from one to another equally valued reward, a manipulation that induces errors only in reward feature prediction. Preventing dopamine neurons in the ventral tegmental area fr...Continue Reading
Citations
Apr 6, 2019·ELife·Javier A SuarezThorsten Kahnt
Nov 23, 2018·Proceedings. Biological Sciences·Matthew P H GardnerSamuel J Gershman
Jul 25, 2019·The European Journal of Neuroscience·Veronica DobrovitskyJon C Horvitz
Dec 22, 2019·The European Journal of Neuroscience·Deirdre A SackettRegina M Carelli
Jun 1, 2019·Schizophrenia Bulletin·Benjamin R FryAlexander W Johnson
Jan 9, 2020·Nature Communications·Melissa J SharpeGeoffrey Schoenbaum
Jun 26, 2020·Hippocampus·William de Cothi, Caswell Barry
Feb 15, 2020·Journal of Neuroscience Research·Anne L Collins, Benjamin T Saunders
Oct 10, 2018·Proceedings of the National Academy of Sciences of the United States of America·Matthew M NourOliver D Howes
Jan 22, 2020·Nature Neuroscience·Etienne J P MaesMihaela D Iordanova
Jun 29, 2018·Nature Communications·Ray LuoJoshua P Johansen
Nov 2, 2019·ELife·Thomas A StalnakerGeoffrey Schoenbaum
Jun 14, 2018·Frontiers in Synaptic Neuroscience·Nicholas M GrazianeYan Dong
Jan 17, 2021·Neuroscience and Biobehavioral Reviews·Mihaela D IordanovaLaura H Corbit
Feb 11, 2021·Neuropharmacology·Jacqueline A QuigleyJill B Becker
Mar 24, 2020·Neural Networks : the Official Journal of the International Neural Network Society·Minryung R Song, Sang Wan Lee
Nov 14, 2020·Current Opinion in Neurobiology·Clara Kwon Starkweather, Naoshige Uchida
Jul 28, 2021·Current Biology : CB·Kauê Machado Costa, Geoffrey Schoenbaum
Oct 1, 2021·Neuropsychopharmacology : Official Publication of the American College of Neuropsychopharmacology·Samuel J MillardMelissa J Sharpe