Perception of audiovisual speech synchrony for native and non-native language

Brain Research
Jordi NavarraCharles Spence

Abstract

To what extent does our prior experience with the correspondence between audiovisual stimuli influence how we subsequently bind them? We addressed this question by testing English and Spanish speakers (having little prior experience of Spanish and English, respectively) on a crossmodal simultaneity judgment (SJ) task with English or Spanish spoken sentences. The results revealed that the visual speech stream had to lead the auditory speech stream by a significantly larger interval in the participants' native language than in the non-native language for simultaneity to be perceived. Critically, the difference in temporal processing between perceiving native vs. non-native language tends to disappear as the amount of experience with the non-native language increases. We propose that this modulation of multisensory temporal processing as a function of prior experience is a consequence of the constraining role that visual information plays in the temporal alignment of audiovisual speech signals.

References

Dec 23, 1976·Nature·H McGurk, J MacDonald
Jan 1, 1980·Perception·N F Dixon, L Spitz
Mar 1, 1980·Cognition·W Marslen-Wilson, L K Tyler
Apr 1, 1996·Perception & Psychophysics·K G MunhallM Ward
Oct 8, 2003·Perception & Psychophysics·Holger Mitterer, Leo Blomert
Jan 30, 2004·Language and Speech·Catherine C Best, Gerald W McRoberts
Jun 15, 2004·Nature Neuroscience·Waka FujisakiShin'ya Nishida
Nov 25, 2004·Brain Research. Cognitive Brain Research·Jean VroomenPaul Bertelson
Jan 14, 2005·Proceedings of the National Academy of Sciences of the United States of America·Virginie van WassenhoveDavid Poeppel
May 12, 2005·Current Biology : CB·Agnès AlsiusSalvador Soto-Faraco
Aug 27, 2005·Perception & Psychophysics·Massimiliano ZampiniCharles Spence
Sep 3, 2005·Brain Research. Cognitive Brain Research·Jordi NavarraCharles Spence
Nov 3, 2005·Journal of Experimental Psychology. Human Perception and Performance·Jordi NavarraSalvador Soto-Faraco
Apr 29, 2006·Journal of Vision·Roberto ArrighiDavid Burr
Aug 1, 2006·Brain Research·Argiro Vatakis, Charles Spence
Aug 18, 2006·Journal of Neurophysiology·Mark T Wallace, Barry E Stein
Dec 13, 2006·Neuroscience Letters·Jordi NavarraCharles Spence
Apr 14, 2007·Experimental Brain Research·Argiro VatakisCharles Spence
Apr 17, 2007·Neuroreport·Salvador Soto-Faraco, Agnès Alsius
May 26, 2007·Science·Whitney M WeikumJanet F Werker
Jun 15, 2007·Perception & Psychophysics·Salvador Soto-FaracoJanet F Werker
Sep 22, 2007·Experimental Brain Research·Camille KoppenCharles Spence
Sep 28, 2007·Experimental Brain Research·Agnès AlsiusSalvador Soto-Faraco
Oct 13, 2007·Perception & Psychophysics·Argiro Vatakis, Charles Spence
Feb 1, 2008·Experimental Brain Research·James V M HansonDavid Whitaker
Mar 13, 2008·Developmental Science·Kaoru Sekiyama, Denis Burnham
Jun 6, 2008·Journal of Neurophysiology·Ilana B WittenHaim Sompolinsky
Jan 6, 2009·Cognition·Karin PetriniFrank Pollick
May 22, 2009·Proceedings of the National Academy of Sciences of the United States of America·Jordi NavarraCharles Spence
Jul 9, 2009·Journal of Cognitive Neuroscience·Jean Vroomen, Jeroen J Stekelenburg
Dec 9, 2009·Journal of Experimental Psychology. Human Perception and Performance·Michael Schutz, Michael Kubovy

❮ Previous
Next ❯

Citations

Feb 7, 2013·Experimental Brain Research·Carolina Sánchez-GarcíaSalvador Soto-Faraco
Jul 23, 2013·Brain and Language·Alfonso Barrós-LoscertalesSalvador Soto-Faraco
Apr 16, 2011·PloS One·Warrick RoseboomDerek H Arnold
Sep 18, 2012·Infant Behavior & Development·Ferran PonsJordi Navarra
Dec 10, 2015·Cognition·Elan BarenholtzDavid J Lewkowicz
Mar 1, 2014·Acta Psychologica·Ferran Pons, David J Lewkowicz
Apr 11, 2015·Frontiers in Integrative Neuroscience·Durk Talsma
Feb 15, 2014·Developmental Cognitive Neuroscience·Franziska Kopp
Apr 10, 2014·Frontiers in Psychology·Nicholas Altieri
Sep 16, 2014·Frontiers in Aging Neuroscience·Yu Man ChanAllison M McKendrick
May 13, 2018·Brain Sciences·Viorica MarianScott R Schroeder

❮ Previous
Next ❯

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.

Related Papers

The Journal of Neuroscience : the Official Journal of the Society for Neuroscience
Albert R PowersMark T Wallace
Nature Neuroscience
Waka FujisakiShin'ya Nishida
© 2021 Meta ULC. All rights reserved