PMID: 11919005Mar 29, 2002Paper

Processing of changes in visual speech in the human auditory cortex

Brain Research. Cognitive Brain Research
Riikka MöttönenMikko Sams

Abstract

Seeing a talker's articulatory gestures may affect the observer's auditory speech percept. Observing congruent articulatory gestures may enhance the recognition of speech sounds [J. Acoust. Soc. Am. 26 (1954) 212], whereas observing incongruent gestures may change the auditory percept phonetically as occurs in the McGurk effect [Nature 264 (1976) 746]. For example, simultaneous acoustic /ba/ and visual /ga/ are usually heard as /da/. We studied cortical processing of occasional changes in audiovisual and visual speech stimuli with magnetoencephalography. In the audiovisual experiment congruent (acoustic /iti/, visual /iti/) and incongruent (acoustic /ipi/, visual /iti/) audiovisual stimuli, which were both perceived as /iti/, were presented among congruent /ipi/ (acoustic /ipi/, visual /ipi/) stimuli. In the visual experiment only the visual components of these stimuli were presented. A visual change both in audiovisual and visual experiments activated supratemporal auditory cortices bilaterally. The auditory cortex activation to a visual change occurred later in the visual than in the audiovisual experiment, suggesting that interaction between modalities accelerates the detection of visual change in speech.

References

Dec 23, 1976·Nature·H McGurk, J MacDonald
Oct 1, 1985·Electroencephalography and Clinical Neurophysiology·M SamsR Hari
Feb 1, 1980·The Quarterly Journal of Experimental Psychology·R Campbell, B Dodd
Jan 1, 1995·IEEE Transactions on Bio-medical Engineering·J NumminenJ Nenonen
Jan 1, 1994·Medical & Biological Engineering & Computing·M S Hämäläinen, R J Ilmoniemi
Jun 1, 1996·Brain : a Journal of Neurology·P K McGuireC D Frith
Mar 1, 1996·Brain Research. Cognitive Brain Research·G RizzolattiL Fogassi
Apr 1, 1996·Journal of Experimental Psychology. Human Perception and Performance·L D Rosenblum, H M Saldaña
Apr 25, 1997·Science·G A CalvertA S David
Jul 22, 1998·The Journal of the Acoustical Society of America·A Sharma, M F Dorman
Dec 9, 1998·Psychophysiology·E Schröger, A Widmann
Aug 12, 1999·Psychophysiology·I WinklerR Näätänen
Jun 10, 2000·Cerebral Cortex·J R BinderE T Possing
Feb 13, 2001·Brain Research. Cognitive Brain Research·D E CallanE Vatikiotis-Bateson
Feb 15, 2001·Journal of Cognitive Neuroscience·C PhillipsT Roberts
Mar 1, 1962·Journal of Experimental Psychology·M HERSHENSON

❮ Previous
Next ❯

Citations

Oct 12, 2005·Experimental Brain Research·Gabriella MusacchiaNina Kraus
Jul 26, 2005·Experimental Brain Research·Julien BesleMarie-Hélène Giard
Mar 20, 2009·Experimental Brain Research·Jeroen J Stekelenburg, Jean Vroomen
Mar 21, 2009·Experimental Brain Research·Michelle Jarick, Jeffery A Jones
May 4, 2010·Experimental Brain Research·Martijn Baart, Jean Vroomen
Dec 29, 2010·Experimental Brain Research·Kasper EskelundTobias S Andersen
Aug 25, 2007·Brain Structure & Function·Christoph Kayser, Nikos K Logothetis
May 1, 2009·Brain Topography·Curtis W PontonEdward T Auer
Jan 6, 2006·Journal of Autism and Developmental Disorders·Grace Iarocci, John McDonald
Nov 10, 2011·Journal of Autism and Developmental Disorders·Satu SaalastiMikko Sams
Mar 9, 2004·Neuroscience Letters·Jeroen J StekelenburgBeatrice de Gelder
May 9, 2003·Brain and Language·Andrew A FingelkurtsMikko Sams
Aug 7, 2008·Proceedings of the National Academy of Sciences of the United States of America·Elena KushnerenkoGergely Csibra
Jun 24, 2009·Ear and Hearing·Gabriella MusacchiaNina Kraus
Jun 18, 2004·Journal of Cognitive Neuroscience·Daniel E CallanEric Vatikiotis-Bateson
Sep 26, 2007·Journal of Cognitive Neuroscience·Jeroen J Stekelenburg, Jean Vroomen
May 7, 2008·Journal of Cognitive Neuroscience·Daniel S KislyukMikko Sams
Jul 9, 2009·Journal of Cognitive Neuroscience·Jean Vroomen, Jeroen J Stekelenburg
Jan 5, 2010·Journal of Cognitive Neuroscience·Ingo HertrichHermann Ackermann
Nov 30, 2012·Journal of Cognitive Neuroscience·Julien BesleOlivier Bertrand
Aug 23, 2006·Language and Speech·Lawrence BrancazioCarol A Fowler
Jul 12, 2013·PloS One·Takemi MochidaTadahisa Kondo
Nov 2, 2012·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·John S ButlerSophie Molholm
Jul 27, 2011·The Journal of the Acoustical Society of America·Aymeric DevergieFrédéric Berthommier
Jan 8, 2014·Journal of Cognitive Neuroscience·Nicole MalfaitAnne Caclin
Jan 14, 2005·Proceedings of the National Academy of Sciences of the United States of America·Virginie van WassenhoveDavid Poeppel
Nov 12, 2010·Brain and Cognition·Ranmalee EramudugollaJason B Mattingley
Mar 20, 2010·Brain Research Reviews·Risto NäätänenMinna Huotilainen
Jan 19, 2010·Neuroscience Letters·Martijn Baart, Jean Vroomen
Oct 13, 2007·Clinical Neurophysiology : Official Journal of the International Federation of Clinical Neurophysiology·R NäätänenK Alho
Jul 3, 2007·NeuroImage·S WatkinsG Rees
Oct 28, 2006·Neuropsychologia·Ingo HertrichHermann Ackermann
Sep 29, 2004·The European Journal of Neuroscience·Julien BesleMarie-Hélène Giard
Aug 21, 2004·Psychophysiology·Andreas WidmannErich Schröger
Sep 26, 2009·Human Brain Mapping·Margo McKenna BenoitSteven Stufflebeam
Mar 1, 2005·NeuroImage·Jeremy I SkipperSteven L Small
Apr 12, 2005·Brain Research. Cognitive Brain Research·Mikko SamsToni Sihvonen

❮ Previous
Next ❯

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.