Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading

Nature
J Driver

Abstract

Mechanisms of human attention allow selective processing of just the relevant events among the many stimuli bombarding our senses. Most laboratory studies examine attention within just a single sense, but in the real world many important events are specified multimodally, as in verbal communication. Speech comprises visual lip movements as well as sounds, and lip-reading contributes to speech perception, even for listeners with good hearing, by a process of audiovisual integration. Such examples raise the problem of how we coordinate our spatial attention across the sensory modalities, to select sights and sounds from a common source for further processing. Here we show that this problem is alleviated by allowing some cross-modal matching before attentional selection is completed. Cross-modal matching can lead to an illusion, whereby sounds are mislocated at their apparent visual source; this crossmodal illusion can enhance selective spatial attention to speech sounds.

Citations

Sep 30, 2005·Experimental Brain Research·Eunhui Lie, H Branch Coslett
Apr 8, 2009·Experimental Brain Research·Daniel R Berger, Heinrich H Bülthoff
Mar 25, 2011·Experimental Brain Research·Agnès Alsius, Salvador Soto-Faraco
Mar 20, 2012·Experimental Brain Research·Lucy M McGarryJaime A Pineda
Mar 19, 2005·Neuroscience Letters·Ladan ShamsJoydeep Bhattacharya
Oct 7, 2003·Neuropsychologia·Salvador Soto-FaracoCharles Spence
Dec 2, 1999·Neuroscience and Biobehavioral Reviews·A TobenaR Dar
Sep 27, 2003·International Journal of Psychophysiology : Official Journal of the International Organization of Psychophysiology·Steve Guest, Charles Spence
Jun 14, 2002·Brain Research. Cognitive Brain Research·Salvador Soto-FaracoAlan Kingstone
Jun 23, 1998·Current Opinion in Neurobiology·J Driver, C Spence
Dec 1, 1997·Trends in Cognitive Sciences·C J Darwin
Apr 17, 2002·Clinical Neurophysiology : Official Journal of the International Federation of Clinical Neurophysiology·C ColinP Deltenre
Jul 10, 2003·Journal of Experimental Psychology. Human Perception and Performance·Rhodri Cusack, Robert P Carlyon
Jul 19, 2006·Journal of Experimental Psychology. Human Perception and Performance·Jean Vroomen, Mirjam Keetels
Apr 22, 2004·Neuropsychology·Andrew R Mayer, D S Kosson
Aug 24, 2005·Nature Neuroscience·Yutaka KomuraTaketoshi Ono
Dec 25, 2009·Chemical Senses·Maria G VeldhuizenLawrence E Marks
Apr 17, 2007·Neuroreport·Salvador Soto-Faraco, Agnès Alsius
Apr 19, 2006·Proceedings. Biological Sciences·Waka FujisakiShin'ya Nishida
Oct 14, 1998·Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences·J Driver, C Spence
Sep 11, 2007·Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences·Ruth Campbell
Jun 27, 2001·The Journal of the Acoustical Society of America·L GirinG Feng
Jan 1, 2000·The Journal of the Acoustical Society of America·R L FreymanR K Clifton
Apr 9, 2005·Journal of Cognitive Neuroscience·Nick E BarracloughDavid I Perrett
Aug 17, 2005·Journal of Cognitive Neuroscience·Durk Talsma, Marty G Woldorff
Aug 23, 2006·Language and Speech·Lawrence BrancazioCarol A Fowler
Mar 13, 2010·BMC Neuroscience·Marianne LatinusMargot J Taylor
Apr 13, 2006·BMC Neuroscience·Wido NagerThomas F Münte
Jul 19, 2012·PloS One·Erik Van der BurgJan Theeuwes
Aug 27, 2005·Perception & Psychophysics·Salvador Soto-FaracoAlan Kingstone
Aug 4, 2007·Perception & Psychophysics·Maori KobayashiMakio Kashino
Apr 9, 2005·Perception & Psychophysics·Andrew J Sach, Peter J Bailey
May 16, 2003·Psychonomic Bulletin & Review·Brenda Rapp, Sharma K Hendel
Aug 27, 1998·Perception & Psychophysics·E Vatikiotis-BatesonK G Munhall
Oct 18, 2008·Perception & Psychophysics·Wendy E HuddlestonEdgar A DeYoe
May 25, 2012·Attention, Perception & Psychophysics·Mario MaiwormBrigitte Röder
May 28, 2013·Attention, Perception & Psychophysics·Lihan Chen, Jean Vroomen
Feb 18, 2011·Psychonomic Bulletin & Review·Shoko Kanaya, Kazuhiko Yokosawa
Mar 14, 1998·Proceedings of the National Academy of Sciences of the United States of America·G H Recanzone
Dec 13, 2005·Proceedings of the National Academy of Sciences of the United States of America·Laura BusseMarty G Woldorff
May 12, 2009·The Journal of the Acoustical Society of America·Joshua G W Bernstein, Ken W Grant

❮ Previous
Next ❯

Related Concepts

Related Feeds

Auditory Perception

Auditory perception is the ability to receive and interpret information attained by the ears. Here is the latest research on factors and underlying mechanisms that influence auditory perception.