Weak observer-level correlation and strong stimulus-level correlation between the McGurk effect and audiovisual speech-in-noise: A causal inference explanation.

Cortex; a Journal Devoted to the Study of the Nervous System and Behavior
John F MagnottiMichael S Beauchamp

Abstract

The McGurk effect is a widely used measure of multisensory integration during speech perception. Two observations have raised questions about the validity of the effect as a tool for understanding speech perception. First, there is high variability in perception of the McGurk effect across different stimuli and observers. Second, across observers there is low correlation between McGurk susceptibility and recognition of visual speech paired with auditory speech-in-noise, another common measure of multisensory integration. Using the framework of the causal inference of multisensory speech (CIMS) model, we explored the relationship between the McGurk effect, syllable perception, and sentence perception in seven experiments with a total of 296 different participants. Perceptual reports revealed a relationship between the efficacy of different McGurk stimuli created from the same talker and perception of the auditory component of the McGurk stimuli presented in isolation, both with and without added noise. The CIMS model explained this strong stimulus-level correlation using the principles of noisy sensory encoding followed by optimal cue combination within a common representational space across speech types. Because the McGurk effe...Continue Reading

References

Dec 23, 1976·Nature·H McGurk, J MacDonald
Sep 24, 1999·The Journal of the Acoustical Society of America·K W Grant, P F Seitz
Feb 25, 2000·The Journal of the Acoustical Society of America·K W Grant, P F Seitz
Jul 31, 2001·Nature Neuroscience·S DeneveA Pouget
Feb 6, 2004·Current Biology : CB·David Alais, David Burr
Feb 24, 2007·Hearing Research·Matthew H Davis, Ingrid S Johnsrude
Sep 27, 2007·PloS One·Konrad P KördingLadan Shams
Apr 1, 2009·Journal of Experimental Psychology. Human Perception and Performance·Salvador Soto-Faraco, Agnès Alsius
Aug 14, 2010·Trends in Cognitive Sciences·Ladan Shams, Ulrik R Beierholm
May 18, 2011·Journal of Experimental Psychology. Human Perception and Performance·Jintao Jiang, Lynne E Bernstein
Mar 7, 2012·Journal of Experimental Psychology. Human Perception and Performance·Ryan A StevensonMark T Wallace
Dec 3, 2013·Frontiers in Psychology·John F MagnottiMichael S Beauchamp
Jun 12, 2014·Frontiers in Psychology·Laura C EricksonJosef P Rauschecker
Sep 24, 2014·Psychonomic Bulletin & Review·John F Magnotti, Michael S Beauchamp
Mar 25, 2015·Psychonomic Bulletin & Review·Debshila Basu MallickMichael S Beauchamp
Mar 27, 2015·Attention, Perception & Psychophysics·Demet GurlerMichael Beauchamp
Apr 22, 2015·Cortex; a Journal Devoted to the Study of the Nervous System and Behavior·Jonathan E Peelle, Mitchell S Sommers
May 27, 2015·Cortex; a Journal Devoted to the Study of the Nervous System and Behavior·Itsaso OlasagastiAnne-Lise Giraud
Jun 5, 2015·Experimental Brain Research·John F MagnottiMichael S Beauchamp
Sep 13, 2015·NeuroImage·Johannes Tuennerhoff, Uta Noppeney
Oct 1, 2015·NeuroImage·Remi Gau, Uta Noppeney
Mar 6, 2016·Psychological Science·Brian Odegaard, Ladan Shams
Dec 7, 2016·Attention, Perception & Psychophysics·Kristin J Van EngenBharath Chandrasekaran
Feb 17, 2017·PLoS Computational Biology·John F Magnotti, Michael S Beauchamp
Aug 10, 2017·Human Brain Mapping·Luis Morís FernándezSalvador Soto-Faraco
Sep 28, 2017·The European Journal of Neuroscience·Cristiano CuppiniMauro Ursino
Nov 7, 2017·Journal of Phonetics·Arthur S Abramson, D H Whalen
Apr 1, 2018·Annals of the New York Academy of Sciences·Uta Noppeney, Hwee Ling Lee
May 26, 2018·Journal of Speech, Language, and Hearing Research : JSLHR·Julia F StrandJulia Smith
Jun 22, 2018·Perspectives on Psychological Science : a Journal of the Association for Psychological Science·Michael D BuhrmesterSamuel D Gosling
Jul 24, 2018·Journal of Phonetics·D H WhalenHosung Nam
Sep 20, 2018·PloS One·John F Magnotti, Michael S Beauchamp
Dec 24, 2018·Scientific Reports·John F MagnottiMichael S Beauchamp
Mar 28, 2019·Scientific Reports·Derek H ArnoldAlan Johnston
Jan 1, 2018·Multisensory Research·Michael S Beauchamp
Jan 1, 2018·Multisensory Research·Carolina Sánchez-GarcíaSalvador Soto-Faraco
Jan 1, 2018·Multisensory Research·Agnès AlsiusKevin G Munhall
Jan 1, 2018·Multisensory Research·John F MagnottiMichael S Beauchamp

❮ Previous
Next ❯

Citations

Apr 23, 2021·Attention, Perception & Psychophysics·Laura M Getz, Joseph C Toscano
Apr 20, 2021·Frontiers in Human Neuroscience·Mariel G GonzalesAntoine J Shahin

❮ Previous
Next ❯

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.