Signals of anticipation of reward and of mean reward rates in the human brain.

Scientific Reports
Roberto VivianiPetra Beschoner

Abstract

Theoretical models of dopamine function stemming from reinforcement learning theory have emphasized the importance of prediction errors, which signal changes in the expectation of impending rewards. Much less is known about the effects of mean reward rates, which may be of motivational significance due to their role in computing the optimal effort put into exploiting reward opportunities. Here, we used a reinforcement learning model to design three functional neuroimaging studies and disentangle the effects of changes in reward expectations and mean reward rates, showing recruitment of specific regions in the brainstem regardless of prediction errors. While changes in reward expectations activated ventral striatal areas as in previous studies, mean reward rates preferentially modulated the substantia nigra/ventral tegmental area, deep layers of the superior colliculi, and a posterior pontomesencephalic region. These brainstem structures may work together to set motivation and attentional efforts levels according to perceived reward opportunities.

References

Dec 1, 1991·The American Journal of Psychiatry·S E Abbey, P E Garfinkel
Jan 1, 1996·Journal of Cerebral Blood Flow and Metabolism : Official Journal of the International Society of Cerebral Blood Flow and Metabolism·A P HolmesI Ford
Sep 1, 1995·Journal of Magnetic Resonance Imaging : JMRI·J VymazalR A Brooks
Mar 14, 1997·Science·W SchultzP R Montague
Jun 2, 1998·Nature·M J KoeppP M Grasby
Jul 11, 1998·Journal of Neurophysiology·W Schultz
Dec 22, 1998·Brain Research. Brain Research Reviews·K C Berridge, T E Robinson
Jan 10, 2001·Annual Review of Psychology·C MaslachM P Leiter
Jan 22, 2002·Nature Neuroscience·Giuseppe PagnoniGregory S Berns
Oct 10, 2002·Neural Networks : the Official Journal of the International Neural Network Society·Yasushi Kobayashi, Tadashi Isa
Oct 18, 2002·Neuron·P Read Montague, Gregory S Berns
Apr 30, 2003·Neuron·John P O'DohertyRaymond J Dolan
Apr 30, 2003·Neuron·Samuel M McClureP Read Montague
Aug 6, 2003·Trends in Neurosciences·Samuel M McClureP Read Montague
Feb 12, 2005·Biological Psychiatry·Diego A PizzagalliJames P O'Shea
Jul 6, 2005·Neuron·Hannah M Bayer, Paul W Glimcher
Sep 30, 2005·Journal of Neurophysiology·Philippe N ToblerWolfram Schultz
Mar 29, 2006·Biological Psychiatry·Eric J Nestler, William A Carlezon
Sep 5, 2006·Neural Networks : the Official Journal of the International Neural Network Society·M E WaltonM F S Rushworth
Sep 16, 2006·Psychopharmacology·T W Robbins, B J Everitt
Oct 13, 2006·Psychopharmacology·Yael NivPeter Dayan
Nov 23, 2006·Nature Reviews. Neuroscience·Peter Redgrave, Kevin Gurney
Nov 23, 2006·Psychopharmacology·Paul E M PhillipsThomas C Jhou
Dec 22, 2006·PloS One·Jian LiP Read Montague
May 4, 2007·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Ben SeymourRay Dolan
Jul 29, 2008·Nature Neuroscience·Christopher D FiorilloWolfram Schultz
Apr 4, 2009·Proceedings of the National Academy of Sciences of the United States of America·Larry S ZweifelRichard D Palmiter
May 19, 2009·Trends in Neurosciences·Emrah DüzelPhilippe N Tobler
Jul 18, 2009·Neuron·Ethan S Bromberg-Martin, Okihide Hikosaka
Aug 14, 2009·Neuropsychopharmacology : Official Publication of the American College of Neuropsychopharmacology·Susan R Sesack, Anthony A Grace
Jul 7, 2010·Neuroscience and Biobehavioral Reviews·Michael T Treadway, David H Zald

❮ Previous
Next ❯

Citations


❮ Previous
Next ❯

Software Mentioned

Adobe Illustrator
snap
ITK
Julia
lme4
SPM
- Snap
SPM12
lmerTest
Julia package

Related Concepts

Related Feeds

Basal Ganglia

Basal Ganglia are a group of subcortical nuclei in the brain associated with control of voluntary motor movements, procedural and habit learning, emotion, and cognition. Here is the latest research.