Two spatiotemporally distinct value systems shape reward-based learning in the human brain

Nature Communications
Elsa FouragnanMarios G Philiastides

Abstract

Avoiding repeated mistakes and learning to reinforce rewarding decisions is critical for human survival and adaptive actions. Yet, the neural underpinnings of the value systems that encode different decision-outcomes remain elusive. Here coupling single-trial electroencephalography with simultaneously acquired functional magnetic resonance imaging, we uncover the spatiotemporal dynamics of two separate but interacting value systems encoding decision-outcomes. Consistent with a role in regulating alertness and switching behaviours, an early system is activated only by negative outcomes and engages arousal-related and motor-preparatory brain structures. Consistent with a role in reward-based learning, a later system differentially suppresses or activates regions of the human reward network in response to negative and positive outcomes, respectively. Following negative outcomes, the early system interacts and downregulates the late system, through a thalamic interaction with the ventral striatum. Critically, the strength of this coupling predicts participants' switching behaviour and avoidance learning, directly implicating the thalamostriatal pathway in reward-based learning.

References

Aug 1, 1978·The Journal of Comparative Neurology·R Y MooreB E Jones
Nov 5, 1997·NeuroImage·K J FristonR J Dolan
Nov 5, 1999·NeuroImage·K J FristonA M Dale
Dec 29, 2000·Nature Neuroscience·P DayanP R Montague
Jan 3, 2001·Nature Neuroscience·J O'DohertyC Andrews
Jun 8, 2001·News in Physiological Sciences : an International Journal of Physiology Produced Jointly by the International Union of Physiological Sciences and the American Physiological Society·Wolfram Schultz
Jan 2, 2003·Magnetic Resonance in Medicine : Official Journal of the Society of Magnetic Resonance in Medicine·Mark Jenkinson
Jun 25, 2003·Brain : a Journal of Neurology·Hugo D CritchleyRaymond J Dolan
Sep 2, 2003·NeuroImage·K J FristonW Penny
Jun 1, 1956·Brain : a Journal of Neurology·W M COWAN, T P POWELL
Feb 14, 2004·Science·John G KernsCameron S Carter
May 21, 2004·Nature Reviews. Neuroscience·Roy A Wise
Jul 16, 2004·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Nick Yeung, Alan G Sanfey
Oct 27, 2004·NeuroImage·Stephen M SmithPaul M Matthews
Jan 11, 2005·IEEE Transactions on Medical Imaging·Mark W WoolrichStephen M Smith
Mar 12, 2005·Science·Philippe N ToblerWolfram Schultz
Jun 18, 2005·Science·Takafumi MinamimotoMinoru Kimura
Jul 12, 2005·Biological Psychology·Greg HajcakRobert F Simons
Aug 9, 2005·NeuroImage·Lucas C ParraPaul Sajda
Sep 17, 2005·Trends in Neurosciences·Sebastien Bouret, Susan J Sara
Jan 30, 2007·NeuroImage·Michael X CohenCharan Ranganath
Apr 12, 2007·Journal of Biosciences·Klaas E StephanKarl J Friston
May 4, 2007·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Ben SeymourRay Dolan
Oct 5, 2007·Proceedings of the National Academy of Sciences of the United States of America·Michael J FrankKent E Hutchison
Dec 17, 2008·Human Brain Mapping·Keri S TaylorKaren D Davis
Jun 12, 2009·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Michael X CohenThomas E Schlaepfer
May 5, 2010·Proceedings of the National Academy of Sciences of the United States of America·Marios G PhiliastidesHauke R Heekeren
Jun 1, 2010·NeuroImage·Marios G PhiliastidesHauke R Heekeren
Jul 6, 2010·NeuroImage·Benjamin BlankertzKlaus-Robert Müller
Oct 1, 2010·Neuropsychopharmacology : Official Publication of the American College of Neuropsychopharmacology·Y-Lan Boureau, Peter Dayan
Nov 30, 2010·NeuroImage·Franco CaudaAlessandro Vercelli
Dec 15, 2010·Neuron·Ethan S Bromberg-MartinOkihide Hikosaka
Mar 4, 2011·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Sebastian SeifertMarkus Ullsperger
Jul 23, 2011·Frontiers in Psychology·Megan DebettencourtPaul Sajda

❮ Previous
Next ❯

Citations

Aug 27, 2016·PloS One·Pavan RamkumarKonrad Kording
Jun 10, 2017·Nature Communications·M Andrea PisauroMarios G Philiastides
Apr 26, 2018·Neurodegenerative Disease Management·Ameer MohammedAndreas Demosthenous
Sep 25, 2018·ELife·Sabina Gherman, Marios G Philiastides
Apr 16, 2019·The British Journal of Radiology·Evelien NackaertsAlice Nieuwboer
Nov 30, 2019·Scientific Reports·Hiroshi HigashiShigeki Nakauchi
Feb 6, 2020·Brain Structure & Function·Brendon K BillingsFelix Ströckens
Apr 17, 2019·Nature Neuroscience·Elsa F FouragnanMatthew F S Rushworth
Nov 28, 2020·Human Brain Mapping·Marie LevorsenKeise Izuma
Dec 11, 2020·Social Neuroscience·Francisco Cervantes ConstantinoVictoria B Gradin
May 24, 2021·Cerebral Cortex·Harry J Stewardson, Thomas D Sambrook
Mar 25, 2021·Annual Review of Neuroscience·Marios G PhiliastidesPaul Sajda

❮ Previous
Next ❯

Software Mentioned

FEAT
BVR
Non
Matlab
Brain Vision Recorder ( BVR
- linear Image Registration Tool
FSL
GLM
FMRIB Software Library ( Functional MRI of the Brain
FMRIB

Related Concepts

Related Feeds

Brain Imaging of Neural Circuits (MDS)

Neural circuits are groups of interconnected neurons which carry out specific functions when activated. Imaging these neural circuits allows researches to further elucidate their mechanisms and functions. Follow this feed to stay up to date on brain imaging of neural circuits.

Basal Ganglia

Basal Ganglia are a group of subcortical nuclei in the brain associated with control of voluntary motor movements, procedural and habit learning, emotion, and cognition. Here is the latest research.

Brain Imaging of Neural Circuits

Neural circuits are groups of interconnected neurons which carry out specific functions when activated. Imaging these neural circuits allows researches to further elucidate their mechanisms and functions. Follow this feed to stay up to date on brain imaging of neural circuits.