Talking Points: A Modulating Circle Increases Listening Effort Without Improving Speech Recognition in Young Adults

Psychonomic Bulletin & Review
Julia F StrandDennis L Barbour

Abstract

Speech recognition is improved when the acoustic input is accompanied by visual cues provided by a talking face (Erber in Journal of Speech and Hearing Research, 12(2), 423-425, 1969; Sumby & Pollack in The Journal of the Acoustical Society of America, 26(2), 212-215, 1954). One way that the visual signal facilitates speech recognition is by providing the listener with information about fine phonetic detail that complements information from the auditory signal. However, given that degraded face stimuli can still improve speech recognition accuracy (Munhall, Kroos, Jozan, & Vatikiotis-Bateson in Perception & Psychophysics, 66(4), 574-583, 2004), and static or moving shapes can improve speech detection accuracy (Bernstein, Auer, & Takayanagi in Speech Communication, 44(1-4), 5-18, 2004), aspects of the visual signal other than fine phonetic detail may also contribute to the perception of speech. In two experiments, we show that a modulating circle providing information about the onset, offset, and acoustic amplitude envelope of the speech does not improve recognition of spoken sentences (Experiment 1) or words (Experiment 2). Further, contrary to our hypothesis, the modulating circle increased listening effort despite subjective ...Continue Reading

References

Jan 1, 1979·Phonetica·Q Summerfield
May 1, 1977·The Journal of the Acoustical Society of America·D N KalikowL L Elliott
Aug 1, 1968·The Quarterly Journal of Experimental Psychology·P M Rabbitt
Jun 1, 1969·Journal of Speech and Hearing Research·N P Erber
May 1, 1982·The Journal of Speech and Hearing Disorders·D W Downs
Oct 1, 1996·The Journal of the Acoustical Society of America·K W Grant, B E Walden
Dec 1, 1996·Journal of Speech and Hearing Research·L D RosenblumH M Saldaña
May 19, 2004·Cognition·Jean-Luc SchwartzChristophe Savariaux
Aug 18, 2004·Perception & Psychophysics·K G MunhallE Vatikiotis-Bateson
Mar 12, 2005·The Journal of the Acoustical Society of America·Karen S Helfer, Richard L Freyman
Apr 22, 2009·Journal of Speech, Language, and Hearing Research : JSLHR·Anastasios SarampalisErvin Hafter
Sep 16, 2011·International Journal of Audiology·Penny Anderson Gosselin, Jean-Pierre Gagné
Mar 8, 2012·Behavior Research Methods·Marc BrysbaertEmmanuel Keuleers
Jan 10, 2014·Journal of Memory and Language·Dale J BarrHarry J Tily
Apr 2, 2014·Journal of Speech, Language, and Hearing Research : JSLHR·Kristin J Van EngenBharath Chandrasekaran
Sep 13, 2015·Journal of Speech, Language, and Hearing Research : JSLHR·Scott Seeman, Rebecca Sims
Jun 30, 2016·Ear and Hearing·M Kathleen Pichora-FullerArthur Wingfield
Jan 17, 2017·Trends in Hearing·Jean-Pierre GagnéUlrike Lemke
Feb 13, 2019·Ear and Hearing·Sara AlhanbaliKevin J Munro
Dec 7, 2019·Journal of Cognition·Violet A Brown, Julia F Strand

❮ Previous
Next ❯

Citations

Mar 2, 2021·Perspectives on Psychological Science : a Journal of the Association for Psychological Science·Julia M RohrerTal Yarkoni
Nov 1, 2021·The Journal of the Acoustical Society of America·Justin T FlemingBarbara G Shinn-Cunningham

❮ Previous
Next ❯

Related Concepts

Related Feeds

Auditory Perception

Auditory perception is the ability to receive and interpret information attained by the ears. Here is the latest research on factors and underlying mechanisms that influence auditory perception.

Related Papers

Journal of Experimental Psychology. Learning, Memory, and Cognition
Hans Rutger Bosker
Cortex; a Journal Devoted to the Study of the Nervous System and Behavior
Jonathan E Peelle, Mitchell S Sommers
© 2021 Meta ULC. All rights reserved