Abstract
Speech recognition is improved when the acoustic input is accompanied by visual cues provided by a talking face (Erber in Journal of Speech and Hearing Research, 12(2), 423-425, 1969; Sumby & Pollack in The Journal of the Acoustical Society of America, 26(2), 212-215, 1954). One way that the visual signal facilitates speech recognition is by providing the listener with information about fine phonetic detail that complements information from the auditory signal. However, given that degraded face stimuli can still improve speech recognition accuracy (Munhall, Kroos, Jozan, & Vatikiotis-Bateson in Perception & Psychophysics, 66(4), 574-583, 2004), and static or moving shapes can improve speech detection accuracy (Bernstein, Auer, & Takayanagi in Speech Communication, 44(1-4), 5-18, 2004), aspects of the visual signal other than fine phonetic detail may also contribute to the perception of speech. In two experiments, we show that a modulating circle providing information about the onset, offset, and acoustic amplitude envelope of the speech does not improve recognition of spoken sentences (Experiment 1) or words (Experiment 2). Further, contrary to our hypothesis, the modulating circle increased listening effort despite subjective ...Continue Reading
References
Jan 1, 1979·Phonetica·Q Summerfield
May 1, 1977·The Journal of the Acoustical Society of America·D N KalikowL L Elliott
Aug 1, 1968·The Quarterly Journal of Experimental Psychology·P M Rabbitt
Jun 1, 1969·Journal of Speech and Hearing Research·N P Erber
May 1, 1982·The Journal of Speech and Hearing Disorders·D W Downs
Oct 1, 1996·The Journal of the Acoustical Society of America·K W Grant, B E Walden
Dec 1, 1996·Journal of Speech and Hearing Research·L D RosenblumH M Saldaña
May 19, 2004·Cognition·Jean-Luc SchwartzChristophe Savariaux
Aug 18, 2004·Perception & Psychophysics·K G MunhallE Vatikiotis-Bateson
Mar 12, 2005·The Journal of the Acoustical Society of America·Karen S Helfer, Richard L Freyman
Apr 22, 2009·Journal of Speech, Language, and Hearing Research : JSLHR·Anastasios SarampalisErvin Hafter
Apr 12, 2011·Ear and Hearing·Nancy Tye-MurraySandra Hale
Sep 16, 2011·International Journal of Audiology·Penny Anderson Gosselin, Jean-Pierre Gagné
Mar 8, 2012·Behavior Research Methods·Marc BrysbaertEmmanuel Keuleers
Jan 10, 2014·Journal of Memory and Language·Dale J BarrHarry J Tily
Apr 2, 2014·Journal of Speech, Language, and Hearing Research : JSLHR·Kristin J Van EngenBharath Chandrasekaran
Jul 6, 2014·Ear and Hearing·Erin M Picou, Todd A Ricketts
Sep 13, 2015·Journal of Speech, Language, and Hearing Research : JSLHR·Scott Seeman, Rebecca Sims
Jun 30, 2016·Ear and Hearing·M Kathleen Pichora-FullerArthur Wingfield
Jan 17, 2017·Trends in Hearing·Jean-Pierre GagnéUlrike Lemke
Mar 9, 2018·Psychological Bulletin·Iring KochAndrea Kiesel
Feb 13, 2019·Ear and Hearing·Sara AlhanbaliKevin J Munro
Dec 7, 2019·Journal of Cognition·Violet A Brown, Julia F Strand
Citations
Mar 2, 2021·Perspectives on Psychological Science : a Journal of the Association for Psychological Science·Julia M RohrerTal Yarkoni
Jan 1, 2020·Auditory Perception & Cognition·Julia F StrandViolet A Brown
Nov 1, 2021·The Journal of the Acoustical Society of America·Justin T FlemingBarbara G Shinn-Cunningham