DOI: 10.1101/478131Nov 24, 2018Paper

Dissociable Neural Correlates of Uncertainty Underlie Different Exploration Strategies

BioRxiv : the Preprint Server for Biology
Momchil TomovSamuel Gershman

Abstract

Most real-world decisions involve a delicate balance between exploring unfamiliar alternatives and committing to the best known option. Uncertainty lies at the core of this ''explore-exploit'' dilemma, for if all options were perfectly known, there would be no need to explore. Yet despite the prominent role of uncertainty-guided exploration in decision making, evidence for its neural implementation is still sparse. We investigated this question with model-based fMRI (n = 31) using a two-armed bandit task that independently manipulates two forms of uncertainty underlying different exploration strategies. The relative uncertainty between the two options was correlated with BOLD activity in right rostrolateral prefrontal cortex and drove directed exploration, a strategy that adds an uncertainty bonus to each option. The total uncertainty across the two options was correlated with activity in right dorsolateral prefrontal cortex and drove random exploration, a strategy that increases choice stochasticity in proportion to total uncertainty. The subjective estimates of uncertainty from both regions were predictive of subject choices. Finally, the decision value signal combining relative and total uncertainty to compute choice was ref...Continue Reading

Related Concepts

Decision Making
Randomization
Prefrontal Cortex
FMRI
Core
Downstream
Computed (Procedure)
Blood Oxygen Level Dependant Functional Magnetic Resonance Imaging
Pyramidal Cell of Precentral Gyrus of Cerebral Hemisphere
Right Prefrontal Cortex

Related Feeds

BioRxiv & MedRxiv Preprints

BioRxiv and MedRxiv are the preprint servers for biology and health sciences respectively, operated by Cold Spring Harbor Laboratory. Here are the latest preprint articles (which are not peer-reviewed) from BioRxiv and MedRxiv.

Related Papers

BioRxiv : the Preprint Server for Biology
Samuel Gershman
BioRxiv : the Preprint Server for Biology
B. QiuOlga Boudker
BioRxiv : the Preprint Server for Biology
Wojciech K. ZajkowskiMalgorzata Kossut
© 2021 Meta ULC. All rights reserved