Optimal multisensory decision-making in a reaction-time task

Jan DrugowitschAlexandre Pouget


Humans and animals can integrate sensory evidence from various sources to make decisions in a statistically near-optimal manner, provided that the stimulus presentation time is fixed across trials. Little is known about whether optimality is preserved when subjects can choose when to make a decision (reaction-time task), nor when sensory inputs have time-varying reliability. Using a reaction-time version of a visual/vestibular heading discrimination task, we show that behavior is clearly sub-optimal when quantified with traditional optimality metrics that ignore reaction times. We created a computational model that accumulates evidence optimally across both cues and time, and trades off accuracy with decision speed. This model quantitatively explains subjects's choices and reaction times, supporting the hypothesis that subjects do, in fact, accumulate evidence optimally over time and across sensory modalities, even when the reaction time is under the subject's control.


May 1, 1984·Perception & Psychophysics·G R GriceJ M Boroughs
Apr 9, 1999·Nature Neuroscience·Kenneth H Britten, R J van Wezel
Jun 26, 1999·Annals of Internal Medicine·S N Goodman
Sep 7, 2000·Journal of Mathematical Psychology·Philip L Smith
Apr 17, 2001·Perception & Psychophysics·Hans Colonius, P Arndt
Jan 22, 2002·Perception & Psychophysics·F A Wichmann, N J Hill
Jun 7, 2002·Cerebral Cortex·Kenneth H Britten, Richard J A Van Wezel
Jul 2, 2002·Journal of Neurophysiology·B D CorneilA J Van Opstal
Jul 19, 2003·Journal of the Optical Society of America. A, Optics, Image Science, and Vision·Peter W BattagliaRichard N Aslin
Sep 18, 2003·Vision Research·David C Knill, Jeffrey A Saunders
Mar 1, 1962·Transactions of the New York Academy of Sciences·D H RAAB
Oct 25, 2003·Cerebral Cortex·Mark E MazurekMichael N Shadlen
Apr 7, 2004·Psychological Review·Roger Ratcliff, Philip L Smith
May 6, 2005·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Anja SchlackFrank Bremmer
Aug 5, 2005·Journal of Neurophysiology·N S C PriceM R Ibbotson
Aug 16, 2005·Journal of Vision·John PalmerMichael N Shadlen
Jan 10, 2006·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Yong GuGregory C DeAngelis
May 5, 2006·Journal of Neurophysiology·Elizabeth A Whitchurch, Terry T Takahashi
Oct 24, 2006·Nature Neuroscience·Wei Ji MaAlexandre Pouget
Jul 7, 2007·Journal of Neurophysiology·Hilary W Heuer, Kenneth H Britten
Mar 21, 2008·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Roozbeh KianiMichael N Shadlen
Sep 2, 2008·Neuron·Michael L MorganDora E Angelaki
Sep 9, 2008·Nature Neuroscience·Yong GuGregory C DeAngelis
Dec 27, 2008·Neuron·Jeffrey M BeckAlexandre Pouget
Mar 25, 2009·NeuroImage·Klaas Enno StephanKarl J Friston
Dec 17, 2009·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Christopher R FetschDora E Angelaki
Jan 26, 2010·Nature Neuroscience·Terrence R StanfordEmilio Salinas
Jul 16, 2010·Journal of Neurophysiology·Christopher R FetschGregory C DeAngelis
Jan 11, 2011·Nature Neuroscience·Arnulf B A GrafJ Anthony Movshon
Mar 19, 2011·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Aihua ChenDora E Angelaki
Aug 19, 2011·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Aihua ChenDora E Angelaki
Nov 22, 2011·Nature Neuroscience·Christopher R FetschDora E Angelaki
Mar 8, 2012·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Yong GuDora E Angelaki
Jul 10, 2012·Current Biology : CB·Thomas U Otto, Pascal Mamassian


Nov 2, 2014·Experimental Brain Research·John S ButlerHeinrich H Bülthoff
Feb 26, 2016·Nature Neuroscience·Alexandre PougetAdam Kepecs
Jan 1, 2016·Neuropsychologia·Christina RegenbogenJohan N Lundström
Sep 1, 2015·ELife·Christopher M GlazeJoshua I Gold
Sep 15, 2015·Neuron·Jeannette A M LorteijePieter R Roelfsema
Apr 18, 2016·Biological cybernetics·Christopher J NashRobert S Bigler
Dec 15, 2015·PloS One·Arjan C ter HorstW Pieter Medendorp
Jan 7, 2017·PloS One·Ksander de WinkelHeinrich H Bülthoff
Jan 27, 2017·PloS One·Alessandro NestiHeinrich H Bülthoff
May 4, 2017·ELife·Frédéric Crevecoeur, Konrad P Kording
Oct 14, 2018·Neural Computation·William T Adler, Wei Ji Ma
Dec 30, 2017·The European Journal of Neuroscience·Hans Colonius, Adele Diederich
May 6, 2020·Experimental Brain Research·Darren M KenneyJudith M Shedden
Oct 16, 2015·Journal of Neurophysiology·Daniel M MerfeldFaisal Karmali
May 26, 2018·Annual Review of Neuroscience·Douglas A RuffMarlene R Cohen
Dec 14, 2018·Frontiers in Cellular Neuroscience·Zhixian Cheng, Yong Gu
Nov 13, 2018·Frontiers in Neural Circuits·Tristan A ChaplinLeo L Lui
Sep 10, 2017·Scientific Reports·Katharina DobsLeila Reddy
Jan 27, 2019·Psychonomic Bulletin & Review·Rahul Bhui
Mar 17, 2019·Attention, Perception & Psychophysics·Gianluca MacaudaFred W Mast
Dec 16, 2020·ELife·Ulrik BeierholmUta Noppeney
Jan 12, 2021·ELife·Sashank PisupatiAnne K Churchland
Oct 30, 2020·Nature Communications·Léon FranzenMarios G Philiastides
Jan 28, 2021·Frontiers in Robotics and AI·William Paul BoyceKongFatt Wong-Lin
Oct 7, 2019·Journal of Neuroscience Methods·Chandramouli Chandrasekaran, Guy E Hawkins
Mar 7, 2021·Cortex; a Journal Devoted to the Study of the Nervous System and Behavior·Samuel A Jones, Uta Noppeney
Nov 6, 2018·Current Biology : CB·Timothy A Currier, Katherine I Nagel
Apr 13, 2021·Biological Psychiatry : Cognitive Neuroscience and Neuroimaging·Jean-Paul NoelMark T Wallace

Related Concepts

Trending Feeds


Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Spatio-Temporal Regulation of DNA Repair

DNA repair is a complex process regulated by several different classes of enzymes, including ligases, endonucleases, and polymerases. This feed focuses on the spatial and temporal regulation that accompanies DNA damage signaling and repair enzymes and processes.

Glut1 Deficiency

Glut1 deficiency, an autosomal dominant, genetic metabolic disorder associated with a deficiency of GLUT1, the protein that transports glucose across the blood brain barrier, is characterized by mental and motor developmental delays and infantile seizures. Follow the latest research on Glut1 deficiency with this feed.

Hereditary Sensory Autonomic Neuropathy

Hereditary Sensory Autonomic Neuropathies are a group of inherited neurodegenerative disorders characterized clinically by loss of sensation and autonomic dysfunction. Here is the latest research on these neuropathies.

Separation Anxiety

Separation anxiety is a type of anxiety disorder that involves excessive distress and anxiety with separation. This may include separation from places or people to which they have a strong emotional connection with. It often affects children more than adults. Here is the latest research on separation anxiety.

Neural Activity: Imaging

Imaging of neural activity in vivo has developed rapidly recently with the advancement of fluorescence microscopy, including new applications using miniaturized microscopes (miniscopes). This feed follows the progress in this growing field.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Related Papers

Experimental Brain Research
Daniel R Berger, Heinrich H Bülthoff
Vision Research
C S RoydenMartin S Banks
The Journal of Neuroscience : the Official Journal of the Society for Neuroscience
David RaposoAnne K Churchland
© 2021 Meta ULC. All rights reserved