Temporal window of integration in auditory-visual speech perception

Neuropsychologia
Virginie van WassenhoveDavid Poeppel

Abstract

Forty-three normal hearing participants were tested in two experiments, which focused on temporal coincidence in auditory visual (AV) speech perception. In these experiments, audio recordings of/pa/and/ba/were dubbed onto video recordings of /ba/or/ga/, respectively (ApVk, AbVg), to produce the illusory "fusion" percepts /ta/, or /da/ [McGurk, H., & McDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746-747]. In Experiment 1, an identification task using McGurk pairs with asynchronies ranging from -467 ms (auditory lead) to +467 ms was conducted. Fusion responses were prevalent over temporal asynchronies from -30 ms to +170 ms and more robust for audio lags. In Experiment 2, simultaneity judgments for incongruent and congruent audiovisual tokens (AdVd, AtVt) were collected. McGurk pairs were more readily judged as asynchronous than congruent pairs. Characteristics of the temporal window over which simultaneity and fusion responses were maximal were quite similar, suggesting the existence of a 200 ms duration asymmetric bimodal temporal integration window.

References

Dec 23, 1976·Nature·H McGurk, J MacDonald
Jun 29, 1992·Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences·S Rosen
Feb 1, 1985·The Journal of the Acoustical Society of America·M McGrath, Q Summerfield
Dec 3, 1971·Nature·G R Engel, W G Dougherty
Jan 1, 1980·Perception·N F Dixon, L Spitz
Jan 1, 1994·Electroencephalography and Clinical Neurophysiology·M SteinschneiderH G Vaughan
Dec 1, 1995·Brain : a Journal of Neurology·D H ffytcheS Zeki
May 1, 1996·Electroencephalography and Clinical Neurophysiology·N LovelessR Hari
Sep 1, 1996·The Journal of the Acoustical Society of America·D W MassaroP M Smeele
Apr 1, 1996·Perception & Psychophysics·K G MunhallM Ward
May 27, 1997·Neuroreport·H YabeR Näätänen
Jul 28, 1997·Neuroreport·H BuchnerR Beckmann
Jan 1, 1997·Perception·C S Campbell, D W Massaro
Apr 27, 2000·Trends in Cognitive Sciences·A M Liberman, D H Whalen
Jan 6, 2001·Perception & Psychophysics·T R JordanS M Thomas
Feb 28, 2001·Perception·J MacDonaldT Bachmann
Aug 8, 2001·Brain Research. Cognitive Brain Research·H YabeS Kaneko
Mar 29, 2002·Brain Research. Cognitive Brain Research·Riikka MöttönenMikko Sams
Feb 28, 2003·Nature·Yoichi Sugita, Yôiti Suzuki
Jul 25, 2003·Experimental Brain Research·Massimiliano ZampiniCharles Spence
Nov 1, 1961·Journal of Experimental Psychology·I J HIRSH, C E SHERRICK
Jun 15, 2004·Nature Neuroscience·Waka FujisakiShin'ya Nishida
Nov 25, 2004·Perception·Agnieszka Kopinska, Laurence R Harris
Nov 25, 2004·Brain Research. Cognitive Brain Research·Jean VroomenPaul Bertelson
Jan 14, 2005·Proceedings of the National Academy of Sciences of the United States of America·Virginie van WassenhoveDavid Poeppel
Feb 22, 2005·Nature Neuroscience·Anthony BoemioDavid Poeppel
Mar 1, 2005·Vision Research·Derek H ArnoldShinya Nishida
Apr 19, 2005·Cognition·Jyrki TuomainenMikko Sams
Jun 3, 2005·Neuroreport·Peter LakatosCharles E Schroeder
Aug 27, 2005·Perception & Psychophysics·Massimiliano ZampiniCharles Spence
Sep 3, 2005·Brain Research. Cognitive Brain Research·Jordi NavarraCharles Spence

❮ Previous
Next ❯

Citations

Aug 11, 2006·Experimental Brain Research·Jeffery A Jones, Michelle Jarick
May 1, 2009·Experimental Brain Research·Karin PetriniFrank E Pollick
Dec 29, 2010·Experimental Brain Research·Kasper EskelundTobias S Andersen
Feb 3, 2011·Experimental Brain Research·Mark C SandersTimothy E Hullar
Mar 23, 2011·Experimental Brain Research·Catarina MendonçaJoan López-Moliner
Aug 28, 2012·Experimental Brain Research·Sarah E DonohueStephen R Mitroff
Jan 12, 2013·Experimental Brain Research·Ryan A StevensonMark T Wallace
Apr 23, 2013·Experimental Brain Research·Ryan A Stevenson, Mark T Wallace
Aug 15, 2013·Brain and Language·Tim ParisChris Davis
May 18, 2011·Journal of Experimental Psychology. Human Perception and Performance·Jintao Jiang, Lynne E Bernstein
Mar 7, 2012·Journal of Experimental Psychology. Human Perception and Performance·Ryan A StevensonMark T Wallace
Jan 1, 2009·Language and Cognitive Processes·Adam B BuchwaldDavid B Pisoni
Jun 16, 2009·The Quarterly Journal of Experimental Psychology : QJEP·Toni CunilleraAntoni Rodriguez-Fornells
Aug 13, 2009·The Quarterly Journal of Experimental Psychology : QJEP·David M C Robertson, Stefan R Schweinberger
Feb 26, 2009·Neuroreport·Akihiro TanakaYôiti Suzuki
Jul 1, 2010·Neuroreport·Marja H BalkIiro P Jääskeläinen
Sep 25, 2007·Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences·David PoeppelVirginie van Wassenhove
Jun 3, 2009·Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences·Marc Wittmann
Jun 3, 2009·Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences·Virginie van Wassenhove
Mar 1, 2012·Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences·Michael Kubovy, Minhong Yu
Jul 3, 2008·Journal of Cognitive Neuroscience·Dries J W FroyenLeo Blomert
Jul 9, 2009·Journal of Cognitive Neuroscience·Jean Vroomen, Jeroen J Stekelenburg
Mar 31, 2010·Journal of Cognitive Neuroscience·Christian ObermeierThomas C Gunter
Sep 28, 2006·PLoS Biology·Katharina von Kriegstein, Anne-Lise Giraud
Jul 18, 2009·PLoS Computational Biology·Chandramouli ChandrasekaranAsif A Ghazanfar
Oct 15, 2011·PLoS Computational Biology·Chandramouli ChandrasekaranAsif A Ghazanfar
Nov 19, 2013·PloS One·Carlos César SilvaJorge Santos
Jan 29, 2010·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Jaakko KauramäkiMikko Sams
Feb 19, 2010·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Michael S BeauchampSiavash Pasalar
Jun 3, 2011·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Sarah E DonohueMarty G Woldorff
May 4, 2010·Attention, Perception & Psychophysics·Sarah E DonohueStephen R Mitroff
May 4, 2010·Attention, Perception & Psychophysics·Jean Vroomen, Mirjam Keetels
Jan 26, 2011·Attention, Perception & Psychophysics·Charles Spence
May 28, 2013·Attention, Perception & Psychophysics·Lihan Chen, Jean Vroomen

❮ Previous
Next ❯

Related Concepts

Related Feeds

Auditory Perception

Auditory perception is the ability to receive and interpret information attained by the ears. Here is the latest research on factors and underlying mechanisms that influence auditory perception.