Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops

Nature Neuroscience
Saori C TanakaShigeto Yamawaki

Abstract

Evaluation of both immediate and future outcomes of one's actions is a critical requirement for intelligent behavior. Using functional magnetic resonance imaging (fMRI), we investigated brain mechanisms for reward prediction at different time scales in a Markov decision task. When human subjects learned actions on the basis of immediate rewards, significant activity was seen in the lateral orbitofrontal cortex and the striatum. When subjects learned to act in order to obtain large future rewards while incurring small immediate losses, the dorsolateral prefrontal cortex, inferior parietal cortex, dorsal raphe nucleus and cerebellum were also activated. Computational model-based regression analysis using the predicted future rewards and prediction errors estimated from subjects' performance data revealed graded maps of time scale within the insula and the striatum: ventroanterior regions were involved in predicting immediate rewards and dorsoposterior regions were involved in predicting future rewards. These results suggest differential involvement of the cortico-basal ganglia loops in reward prediction at different time scales.

References

Nov 20, 1982·The Journal of Comparative Neurology·M M Mesulam, E J Mufson
Feb 1, 1996·The European Journal of Neuroscience·A M OwenA C Evans
Jun 1, 1996·Neuropsychologia·S C BakerT W Robbins
Mar 14, 1997·Science·W SchultzP R Montague
Jun 2, 1998·Nature·M J KoeppP M Grasby
Sep 11, 1999·Trends in Neurosciences·O HikosakaK Doya
Mar 17, 2000·Brain Research. Brain Research Reviews·F A Middleton, P L Strick
Mar 24, 2000·Cerebral Cortex·C CavadaF Reinoso-Suárez
Mar 24, 2000·Cerebral Cortex·E T Rolls
Mar 24, 2000·Cerebral Cortex·A BecharaA R Damasio
Jan 22, 2002·Nature Neuroscience·Giuseppe PagnoniGregory S Berns
Mar 7, 2002·Neuron·John P O'DohertyRaymond J Dolan
Jun 1, 2002·Science·Munetaka Shidara, Barry J Richmond
Oct 10, 2002·Neural Networks : the Official Journal of the International Neural Network Society·Kenji Doya
Oct 10, 2002·Neural Networks : the Official Journal of the International Neural Network Society·John N J Reynolds, Jeffery R Wickens
Apr 30, 2003·Neuron·John P O'DohertyRaymond J Dolan
Apr 30, 2003·Neuron·Samuel M McClureP Read Montague
Jul 12, 2003·Science·Kenji MatsumotoKeiji Tanaka
Feb 20, 2004·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Masahiko HarunoMitsuo Kawato

❮ Previous
Next ❯

Citations

Nov 23, 2006·Psychopharmacology·Paul E M PhillipsThomas C Jhou
May 12, 2012·Brain Structure & Function·C Soriano-MasN Cardoner
Jan 21, 2012·Molecular Neurobiology·Katsuhiko MiyazakiKenji Doya
Jul 2, 2008·The Cerebellum·Patrizia ThomaIrene Daum
Feb 26, 2013·Behavioural Brain Research·Suhyun JoMin Whan Jung
Jul 17, 2013·Progress in Neurobiology·Andrea Bari, Trevor W Robbins
Oct 30, 2007·The Behavioral and Brain Sciences·Thomas Suddendorf, Michael C Corballis
Jul 30, 2008·The Behavioral and Brain Sciences·A David RedishAdam Johnson
Jun 17, 2006·Nature·Nathaniel D DawRaymond J Dolan
Aug 25, 2006·Nature·Mathias PessiglioneChris D Frith
Nov 14, 2008·Nature·Timothy E J BehrensMatthew F S Rushworth
Mar 13, 2012·Nature Neuroscience·Klaus WunderlichRaymond J Dolan
Apr 27, 2012·Nature Neuroscience·Joshua W Buckholtz, René Marois
Mar 29, 2005·Nature Neuroscience·Christelle BaunezMarianne Amalric
Aug 22, 2006·Nature Neuroscience·Peter H RudebeckMatthew F S Rushworth
Nov 6, 2007·Nature Neuroscience·Joseph W Kable, Paul W Glimcher
Oct 9, 2009·Neuropsychopharmacology : Official Publication of the American College of Neuropsychopharmacology·Suzanne N Haber, Brian Knutson
Sep 25, 2009·Neuropsychopharmacology : Official Publication of the American College of Neuropsychopharmacology·Bernard W Balleine, John P O'Doherty
Oct 1, 2010·Neuropsychopharmacology : Official Publication of the American College of Neuropsychopharmacology·Y-Lan Boureau, Peter Dayan
Oct 1, 2010·Neuropsychopharmacology : Official Publication of the American College of Neuropsychopharmacology·Robert D Rogers
May 20, 2011·Neuropsychopharmacology : Official Publication of the American College of Neuropsychopharmacology·Yuliya S NikolovaAhmad R Hariri
Apr 16, 2013·Neuropsychopharmacology : Official Publication of the American College of Neuropsychopharmacology·Elise E DeVitoGodfrey D Pearlson
Nov 9, 2005·Nature Reviews. Neuroscience·Jorge MollJordan Grafman
Mar 22, 2007·Nature Reviews. Neuroscience·Ben SeymourRay Dolan
Sep 8, 2011·Proceedings of the National Academy of Sciences of the United States of America·Kazuki EnomotoMinoru Kimura
Jul 28, 2009·Cognitive Neuropsychiatry·Hao-Yang TanDaniel R Weinberger
Mar 1, 2012·Cerebral Cortex·Elise Metereau, Jean-Claude Dreher
Aug 22, 2007·Social Cognitive and Affective Neuroscience·Michael X Cohen
Feb 12, 2010·Social Cognitive and Affective Neuroscience·Alfonso Barrós-LoscertalesCésar Avila
Jun 23, 2011·Behavioural Pharmacology·Mikhail N KoffarnusJames H Woods
Apr 4, 2007·Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences·R J Dolan
Oct 3, 2008·Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences·Frank KruegerKevin McCabe
Apr 1, 2008·Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences·Mitsuo Kawato
Mar 17, 2009·Science·Kareem A ZaghloulMichael J Kahana
Mar 29, 2008·Annual Review of Clinical Psychology·William G IaconoMatt McGue
Apr 30, 2009·Annual Review of Neuroscience·Peter Dayan, Quentin J M Huys
Jun 19, 2008·Annual Review of Neuroscience·Ann M Graybiel
Jan 14, 2011·Journal of Neurophysiology·Kristine MosierFrancisco J Valero-Cuevas
Jan 24, 2009·Journal of Neurophysiology·Lucy Gregorios-PippasWolfram Schultz
Apr 18, 2008·Journal of Cognitive Neuroscience·Fredrik BissmarckOkihide Hikosaka
May 15, 2008·Journal of Cognitive Neuroscience·Laura MorettiGiuseppe di Pellegrino

❮ Previous
Next ❯

Related Concepts

Related Feeds

Basal Ganglia

Basal Ganglia are a group of subcortical nuclei in the brain associated with control of voluntary motor movements, procedural and habit learning, emotion, and cognition. Here is the latest research.

Related Papers

The Journal of Neuroscience : the Official Journal of the Society for Neuroscience
Samuel M McClureJonathan D Cohen
© 2022 Meta ULC. All rights reserved