Evidence integration in model-based tree search

Proceedings of the National Academy of Sciences of the United States of America
Alec Solway, Matthew Botvinick

Abstract

Research on the dynamics of reward-based, goal-directed decision making has largely focused on simple choice, where participants decide among a set of unitary, mutually exclusive options. Recent work suggests that the deliberation process underlying simple choice can be understood in terms of evidence integration: Noisy evidence in favor of each option accrues over time, until the evidence in favor of one option is significantly greater than the rest. However, real-life decisions often involve not one, but several steps of action, requiring a consideration of cumulative rewards and a sensitivity to recursive decision structure. We present results from two experiments that leveraged techniques previously applied to simple choice to shed light on the deliberation process underlying multistep choice. We interpret the results from these experiments in terms of a new computational model, which extends the evidence accumulation perspective to multiple steps of action.

References

Jan 1, 1997·Spatial Vision·D H Brainard
Sep 1, 1997·Journal of Mathematical Psychology·A Diederich
Aug 8, 2001·Psychological Review·M Usher, J L McClelland
Jan 25, 2002·Experimental Brain Research·Yoriko TakikawaOkihide Hikosaka
Jan 27, 2006·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Kong-Fatt Wong, Xiao-Jing Wang
Oct 13, 2006·Psychopharmacology·Yael NivPeter Dayan
Dec 19, 2007·Neural Computation·Roger Ratcliff, Gail McKoon
Oct 29, 2008·Psychological Review·Per B SederbergMichael J Kahana
Jan 6, 2009·Journal of Memory and Language·Eric-Jan WagenmakersGail McKoon
Jan 23, 2009·Psychological Review·Sean M PolynMichael J Kahana
Aug 21, 2009·Nature·Arbora ResulajMichael N Shadlen
Sep 14, 2010·Nature Neuroscience·Ian KrajbichAntonio Rangel
Mar 26, 2011·Neuron·Nathaniel D DawRaymond J Dolan
Apr 8, 2011·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Dylan Alexander Simon, Nathaniel D Daw
Jul 28, 2011·Neuron·José J F Ribas-FernandesMatthew M Botvinick
Aug 3, 2011·Proceedings of the National Academy of Sciences of the United States of America·Ian Krajbich, Antonio Rangel
Mar 13, 2012·Nature Neuroscience·Klaus WunderlichRaymond J Dolan
Mar 14, 2012·PLoS Computational Biology·Quentin J M HuysJonathan P Roiser
Apr 11, 2012·The European Journal of Neuroscience·Aaron M Bornstein, Nathaniel D Daw
Aug 14, 2012·Neuron·Klaus WunderlichRaymond J Dolan
Oct 16, 2012·Science·G Elliott Wimmer, Daphna Shohamy
Jan 30, 2013·Psychological Review·Andrei R Teodorescu, Marius Usher
Mar 29, 2013·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Carlos DiukYael Niv
Sep 11, 2013·Proceedings of the National Academy of Sciences of the United States of America·R Blythe TowalChristof Koch
Oct 22, 2013·Neuron·Ray J Dolan, Peter Dayan
Dec 11, 2013·Proceedings of the National Academy of Sciences of the United States of America·A Ross OttoNathaniel D Daw
Dec 18, 2013·PLoS Computational Biology·Aaron M Bornstein, Nathaniel D Daw
Aug 15, 2014·PLoS Computational Biology·Alec SolwayMatthew M Botvinick
Feb 13, 2015·Proceedings of the National Academy of Sciences of the United States of America·Quentin J M HuysJonathan P Roiser

❮ Previous
Next ❯

Citations

Sep 14, 2016·Annual Review of Psychology·Samuel J Gershman, Nathaniel D Daw
Feb 23, 2017·Scientific Reports·Alec SolwayP Read Montague
Feb 15, 2019·Scientific Reports·Amitai Shenhav, Uma R Karmarkar
Sep 20, 2017·Proceedings of the National Academy of Sciences of the United States of America·Cristian Buc CalderonTom Verguts
Mar 25, 2018·Biological cybernetics·Raphael Kaplan, Karl J Friston
May 21, 2019·Annual Review of Control, Robotics, and Autonomous Systems·Daniel McNamee, Daniel M Wolpert
Apr 17, 2019·Nature Human Behaviour·Charley M WuBjörn Meder
Sep 27, 2019·Frontiers in Neuroscience·Alec SolwayP Read Montague
May 10, 2018·Frontiers in Psychology·Karl Friston
Mar 23, 2017·Frontiers in Psychology·Elisa M TartagliaMichael H Herzog
Nov 6, 2018·Cognitive Science·Eric SchulzMaarten Speekenbrink
Feb 25, 2021·Neural Computation·Karl FristonThomas Parr
Aug 29, 2021·Neuropsychopharmacology : Official Publication of the American College of Neuropsychopharmacology·Anne G E Collins, Amitai Shenhav

❮ Previous
Next ❯

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.

Related Papers

Cortex; a Journal Devoted to the Study of the Nervous System and Behavior
Amanda Ellison
Topics in Cognitive Science
Maarten Speekenbrink, Emmanouil Konstantinidis
Cognitive, Affective & Behavioral Neuroscience
Darrell A WorthyW Todd Maddox
The Virtual Mentor : VM
Joanna E SiegelKristin L Carman
© 2021 Meta ULC. All rights reserved