Seeing speech affects acoustic information processing in the human brainstem

Experimental Brain Research
Gabriella MusacchiaNina Kraus

Abstract

Afferent auditory processing in the human brainstem is often assumed to be determined by acoustic stimulus features alone and immune to stimulation by other senses or cognitive factors. In contrast, we show that lipreading during speech perception influences early acoustic processing. Event-related brainstem potentials were recorded from ten healthy adults to concordant (acoustic-visual match), conflicting (acoustic-visual mismatch) and unimodal stimuli. Audiovisual (AV) interactions occurred as early as approximately 11 ms post-acoustic stimulation and persisted for the first 30 ms of the response. Furthermore, the magnitude of interaction depended on AV pairings. These findings indicate considerable plasticity in early auditory processing.

References

Feb 1, 1975·Electroencephalography and Clinical Neurophysiology·J T MarshJ C Smith
Jan 1, 1979·Audiology : Official Organ of the International Society of Audiology·J GardiC McKean
Sep 1, 1978·Perception & Psychophysics·J MacDonald, H McGurk
Oct 1, 1977·Experimental Neurology·L C Oatman, B W Anderson
Dec 23, 1976·Nature·H McGurk, J MacDonald
Aug 17, 1991·Lancet·H R Jacobson
Sep 1, 1991·Electroencephalography and Clinical Neurophysiology·M G Woldorff, S A Hillyard
Dec 1, 1987·The Journal of the Acoustical Society of America·M J Middelweerd, R Plomp
May 1, 1987·British Journal of Audiology·A MacLeod, Q Summerfield
Oct 1, 1985·Cognition·A M Liberman, I G Mattingly
Feb 1, 1974·Electroencephalography and Clinical Neurophysiology·T W Picton, S A Hillyard
Apr 1, 1982·Journal of Experimental Psychology. Human Perception and Performance·L E Marks
Sep 1, 1993·Perception & Psychophysics·H M Saldaña, L D Rosenblum
Nov 1, 1995·Perception & Psychophysics·E Ben-Artzi, L E Marks
Apr 1, 1996·Brain : a Journal of Neurology·V GalleseGiacomo Rizzolatti
Apr 25, 1997·Science·G A CalvertA S David
Aug 15, 1998·Journal of Neurophysiology·Mark T WallaceBarry E Stein
Dec 9, 1998·Psychophysiology·E Schröger, A Widmann
Oct 8, 1999·Journal of Cognitive Neuroscience·Marie-Hélène Giard, F Peronnet
Mar 8, 2000·Psychophysiology·J HoormannJ Hohnsbein
Jun 10, 2000·Cerebral Cortex·J R BinderE T Possing
Aug 11, 2000·Journal of Cognitive Neuroscience·M W BurtonS E Blumstein
Sep 29, 2000·The Journal of the Acoustical Society of America·K W Grant, P F Seitz
Nov 1, 2000·Nature·J J McDonaldS A Hillyard
Feb 13, 2001·Brain Research. Cognitive Brain Research·Daniel E CallanEric Vatikiotis-Bateson
Mar 29, 2001·Psychological Science·J J McDonald, L M Ward
May 5, 2001·Clinical Neurophysiology : Official Journal of the International Federation of Clinical Neurophysiology·J CunninghamNina Kraus
Jun 2, 2001·The Journal of the Acoustical Society of America·K W Grant
Mar 29, 2002·Brain Research. Cognitive Brain Research·Riikka MöttönenMikko Sams
Jun 14, 2002·Brain Research. Cognitive Brain Research·W A Teder-SälejärviS A Hillyard
Aug 27, 2002·The Neuroscientist : a Review Journal Bringing Neurobiology, Neurology and Psychiatry·Barry E SteinWan Jiang
Aug 31, 2002·Science·Yoram GutfreundEric I Knudsen
Oct 18, 2002·The European Journal of Neuroscience·Blaise YvertJacques Pernier
Nov 26, 2002·Science·Marc D HauserW Tecumseh Fitch
Dec 24, 2002·Journal of Cognitive Neuroscience·Wan JiangBarry E Stein
Dec 24, 2002·Neuron·Nobuyuki Nishitani, Riitta Hari
Dec 24, 2002·Nature Neuroscience·Khalafalla O BusharaMark Hallett
Jan 2, 2003·Progress in Brain Research·Daniela Zambarbieri
Jan 22, 2003·Trends in Neurosciences·Sophie K Scott, Ingrid S Johnsrude
Apr 11, 2003·Clinical Neurophysiology : Official Journal of the International Federation of Clinical Neurophysiology·Erin A HayesNina Kraus
Aug 22, 2003·Journal of Neurophysiology·Thomas J PerraultMark T Wallace
Oct 3, 2003·Nature Reviews. Neuroscience·Nobuo Suga, Xiaofeng Ma
Oct 10, 2003·Journal of Neurophysiology·Wan Jiang, Barry E Stein
Oct 22, 2003·Neuroscience Research·Kaoru SekiyamaYoichi Sugita
Nov 20, 2003·Neuroreport·Daniel E CallanEric Vatikiotis-Bateson
Nov 25, 2003·Brain Research. Brain Research Reviews·Mari Tervaniemi, Kenneth Hugdahl
Feb 26, 2004·Neuroscience·L R BurnettMark T Wallace
Apr 20, 2004·Neuroreport·Vasily Klucharev, Mikko Sams
Jun 26, 2004·Annual Review of Neuroscience·Giacomo Rizzolatti, Laila Craighero
Aug 6, 2004·Clinical Neurophysiology : Official Journal of the International Federation of Clinical Neurophysiology·Nicole M RussoNina Kraus
Aug 10, 2004·Journal of Cognitive Neuroscience·Kate Watkins, Tomás Paus
Oct 12, 2004·Behavioural Brain Research·Nicole M RussoNina Kraus
Oct 29, 2004·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Mark T WallaceBarry E Stein
Apr 6, 2005·Trends in Neurosciences·Nina Kraus, Trent G Nicol
Oct 19, 2005·Ear and Hearing·Krista L JohnsonNina Kraus

Citations

Dec 1, 2006·Cerebral Cortex·Jennifer K BizleyAndrew J King
Jan 20, 2010·Ear and Hearing·Erika Skoe, Nina Kraus
Dec 1, 2008·Current Directions in Psychological Science·L D Rosenblum
Jan 1, 2014·Journal of Integrative Neuroscience·Aravind Kumar NamasivayamPascal van Lieshout
Sep 26, 2007·Journal of Cognitive Neuroscience·Jeroen J Stekelenburg, Jean Vroomen
May 7, 2008·Journal of Cognitive Neuroscience·Daniel S KislyukMikko Sams
Jul 9, 2009·Journal of Cognitive Neuroscience·Jean Vroomen, Jeroen J Stekelenburg
Aug 22, 2007·PloS One·Corinne TremblayHugo Théoret
Feb 27, 2013·PloS One·W David HairstonKaleb McDowell
Jan 29, 2010·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Jaakko KauramäkiMikko Sams
Jun 27, 2009·Neuropsychiatric Disease and Treatment·Giovanni MerlinoGian Luigi Gigli
Sep 28, 2007·Proceedings of the National Academy of Sciences of the United States of America·Gabriella MusacchiaNina Kraus
Mar 27, 2013·Cerebral Cortex·R L van den BrinkH A Slagter
Jan 22, 2014·Hearing Research·Erika Skoe, Bharath Chandrasekaran
Oct 17, 2012·Attention, Perception & Psychophysics·Jaimie L GilbertSusan M Garnsey
Dec 29, 2010·Experimental Brain Research·Kasper EskelundTobias S Andersen
Nov 26, 2010·Neurophysiologie clinique = Clinical neurophysiology·C RichardH Thai-Van
May 18, 2016·Language, Cognition and Neuroscience·Ariane E RhoneBob McMurray
Dec 8, 2007·Brain Research·Julien RougerPascal Barone
Aug 12, 2015·International Journal of Pediatric Otorhinolaryngology·Maj-Britt Glenn LauritsenJørgen Lous
Sep 26, 2009·Human Brain Mapping·Margo McKenna BenoitSteven Stufflebeam
Nov 2, 2013·Developmental Science·Victoria C P KnowlandMichael S C Thomas
Apr 5, 2016·Journal of Phonetics·James W DiasL D Rosenblum
Jun 30, 2010·The European Journal of Neuroscience·Tommi RaijJohn W Belliveau
Jan 20, 2015·Journal of Integrative Neuroscience·Aravind Kumar NamasivayamPascal van Lieshout
Apr 7, 2009·Current Biology : CB·Kevin MunhallM Paré
Nov 13, 2014·Journal of Cognitive Neuroscience·Benjamin Rich ZendelIsabelle Peretz
Feb 9, 2017·The Annals of Otology, Rhinology, and Laryngology·Bahram JalaeiDinsuhaimi Sidek
Sep 27, 2006·Neuroreport·François ChampouxHugo Théoret
Mar 12, 2010·Journal of Speech, Language, and Hearing Research : JSLHR·Kauyumari SanchezL D Rosenblum
Jun 24, 2009·Ear and Hearing·Gabriella MusacchiaNina Kraus
Sep 18, 2013·Journal of Comparative Physiology. A, Neuroethology, Sensory, Neural, and Behavioral Physiology·Sirpa NummelaTom Reuter
Dec 17, 2015·Attention, Perception & Psychophysics·Jonathan H VeneziaGregory Hickok
Jul 3, 2019·Journal of Perinatology : Official Journal of the California Perinatal Association·Gabriella MusacchiaMatthew B Fitzgerald
Apr 6, 2019·Journal of Speech, Language, and Hearing Research : JSLHR·Jianghua LeiLiang Chen
Jul 21, 2010·Scandinavian Journal of Psychology·Jean-Philippe Vernat, Michael S Gordon

Related Concepts

Acoustic Stimulation
Auditory Perception
Brain Stem
Lipreading
Photic Stimulation
Reaction Time
Public Speaking
Speech Acoustics
Visual Perception
Auditory Brainstem Responses

Related Feeds

Auditory Perception

Auditory perception is the ability to receive and interpret information attained by the ears. Here is the latest research on factors and underlying mechanisms that influence auditory perception.