Normative evidence accumulation in unpredictable environments

ELife
Christopher M GlazeJoshua I Gold

Abstract

In our dynamic world, decisions about noisy stimuli can require temporal accumulation of evidence to identify steady signals, differentiation to detect unpredictable changes in those signals, or both. Normative models can account for learning in these environments but have not yet been applied to faster decision processes. We present a novel, normative formulation of adaptive learning models that forms decisions by acting as a leaky accumulator with non-absorbing bounds. These dynamics, derived for both discrete and continuous cases, depend on the expected rate of change of the statistics of the evidence and balance signal identification and change detection. We found that, for two different tasks, human subjects learned these expectations, albeit imperfectly, then used them to make decisions in accordance with the normative model. The results represent a unified, empirically supported account of decision-making in unpredictable environments that provides new insights into the expectation-driven dynamics of the underlying neural signals.

References

Jan 1, 1983·Vision Research·J Nachmias, B E Rogowitz
Feb 1, 1983·Perception & Psychophysics·A B Watson, D G Pelli
Jul 1, 1981·Journal of the Optical Society of America·D J Lasley, T Cohn
Dec 22, 1999·Nature Neuroscience·P R SchraterE P Simoncelli
Jul 21, 2000·Nature Neuroscience·B A Reddi, R H Carpenter
Feb 13, 2001·Trends in Cognitive Sciences·J I. Gold, M N. Shadlen
Aug 8, 2001·Psychological Review·M Usher, J L McClelland
Feb 11, 2003·Progress in Neurobiology·C W G Clifford, M R Ibbotson
Mar 24, 2004·Trends in Neurosciences·Philip L Smith, Roger Ratcliff
Jun 10, 2005·Neuron·Angela J Yu, Peter Dayan
Aug 16, 2005·Journal of Vision·John PalmerMichael N Shadlen
Oct 28, 2005·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Casimir J H LudwigRoland J Baddeley
Nov 11, 2005·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Alexander C Huk, Michael N Shadlen
May 23, 2006·Nature Reviews. Neuroscience·Naoshige UchidaZachary F Mainen
Jan 19, 2007·The European Journal of Neuroscience·Jochen Ditterich
Jun 30, 2007·Annual Review of Neuroscience·Joshua I Gold, Michael N Shadlen
Aug 7, 2007·Nature Neuroscience·Timothy E J BehrensMatthew F S Rushworth
Nov 4, 2008·Cognitive Psychology·Scott D Brown, Mark Steyvers
Aug 21, 2009·Nature·Arbora ResulajMichael N Shadlen
Sep 18, 2009·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Paul CisekStephany El-Murr
Oct 13, 2009·Trends in Neurosciences·Rafal BogaczSander Nieuwenhuis
Oct 14, 2009·Proceedings of the National Academy of Sciences of the United States of America·Lea K KrugelHauke R Heekeren
Dec 9, 2009·Journal of Experimental Psychology. Human Perception and Performance·Patrick SimenJonathan D Cohen
Jun 24, 2010·Neural Computation·Robert C WilsonJoshua I Gold
Sep 17, 2010·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Matthew R NassarJoshua I Gold
Apr 29, 2011·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Timothy D HanksMichael N Shadlen
Mar 17, 2012·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Jan DrugowitschAlexandre Pouget
Jun 5, 2012·Nature Neuroscience·Matthew R NassarJoshua I Gold
Jun 9, 2012·Frontiers in Neuroscience·Sophie Deneve
Sep 21, 2012·Journal of Neurophysiology·David ThuraPaul Cisek
Jan 3, 2013·The European Journal of Neuroscience·Tomohiro TanakaTadashi Ogawa
Apr 6, 2013·Science·Bingni W BruntonCarlos D Brody
May 21, 2013·Current Biology : CB·Ori OssmyTobias H Donner
Aug 13, 2013·PLoS Computational Biology·Robert C WilsonJoshua I Gold
Aug 27, 2013·Neuron·Long Ding, Joshua I Gold
Aug 30, 2013·Proceedings of the National Academy of Sciences of the United States of America·Jill X O'ReillyMatthew F S Rushworth
May 6, 2014·Current Biology : CB·Luis Nicolas Gonzalez CastroMaurice A Smith
Jun 16, 2014·ELife·Jan DrugowitschAlexandre Pouget

❮ Previous
Next ❯

Citations

Mar 10, 2016·Trends in Cognitive Sciences·Roger RatcliffGail McKoon
Feb 28, 2016·Current Opinion in Neurobiology·David L Barack, Joshua I Gold
May 6, 2016·Frontiers in Computational Neuroscience·Dimitrije Marković, Stefan J Kiebel
Jul 13, 2016·Current Opinion in Behavioral Sciences·A K Churchland, R Kiani
Jul 20, 2016·Proceedings of the National Academy of Sciences of the United States of America·Braden A Purcell, Roozbeh Kiani
Mar 24, 2017·Neural Computation·Adrian E RadilloZachary P Kilpatrick
Apr 17, 2019·Proceedings of the National Academy of Sciences of the United States of America·Andreas MayerThierry Mora
May 20, 2018·Scientific Reports·Zachary P Kilpatrick
Jul 10, 2019·PLoS Computational Biology·Elyse H NortonMichael S Landy
Nov 18, 2019·Journal of Computational Neuroscience·Nicholas W BarendregtZachary P Kilpatrick
Oct 17, 2018·Nature Communications·Alex T PietCarlos D Brody
Nov 23, 2019·The Journal of Experimental Biology·Michael S Reichert, Bernhard Ronacher
May 19, 2020·ELife·Alexandre Ls FilipowiczJoshua I Gold
Feb 28, 2020·Nature Communications·Ainhoa Hermoso-MendizabalJaime de la Rocha
Jul 19, 2017·Annual Review of Vision Science·Joshua I Gold, Alan A Stocker
May 31, 2018·PLoS Computational Biology·Benjamin Skerritt-Davis, Mounya Elhilali
Jul 3, 2019·ELife·Anne E UraiTobias H Donner
Jan 7, 2020·Royal Society Open Science·Subekshya BidariZachary P Kilpatrick
Nov 30, 2019·Nature Communications·Philipp SchustekRubén Moreno-Bote
Apr 14, 2020·PLoS Computational Biology·Chloé PasturelLaurent Udo Perrinet
Apr 10, 2019·PLoS Computational Biology·Micha Heilbron, Florent Meyniel
May 18, 2019·Science·Morteza Sarafyazd, Mehrdad Jazayeri
Oct 20, 2020·ELife·Chang-Hao KaoJoseph W Kable
Jan 6, 2021·Neural Computation·Vasiliki LiakoniJohanni Brea
Aug 25, 2020·Current Opinion in Behavioral Sciences·Gaia TavoniJoshua I Gold
Jan 8, 2021·Frontiers in Neural Circuits·Sean E CavanaghSteven W Kennerley
Mar 8, 2021·Schizophrenia Research·Brandon K AshinoffGuillermo Horga
Jul 22, 2019·Current Opinion in Neurobiology·Zachary P KilpatrickKrešimir Josić
Nov 2, 2019·Current Opinion in Neurobiology·Simon MusallAnne K Churchland
Apr 15, 2021·Nature Communications·Aurélien WeissValentin Wyart
Mar 11, 2021·Journal of Neurophysiology·Bharath Chandra TalluriTobias H Donner
Oct 5, 2021·PLoS Computational Biology·Junior Samuel López-YépezDuda Kvitsiani
Nov 30, 2021·PLoS Computational Biology·Richard D LangeRalf M Haefner

❮ Previous
Next ❯

Software Mentioned

Matlab

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.

Related Papers

Psychological Review
Braden A PurcellThomas J Palmeri
Neural Networks : the Official Journal of the International Neural Network Society
Jose-Manuel Cano-IzquierdoJulio Ibarrola
Frontiers in Integrative Neuroscience
Laurence Casini, Franck Vidal
The Journal of Neuroscience : the Official Journal of the Society for Neuroscience
Manu Chhabra, Robert A Jacobs
© 2021 Meta ULC. All rights reserved