PMID: 15244074Jul 13, 2004Paper

Intermodal timing cues for audio-visual speech recognition

Journal of UOEH
Masahiro Hashimoto, Masaharu Kumashiro

Abstract

The purpose of this study was to investigate the limitations of lip-reading advantages for Japanese young adults by desynchronizing visual and auditory information in speech. In the experiment, audio-visual speech stimuli were presented under the six test conditions: audio-alone, and audio-visually with either 0, 60, 120, 240 or 480 ms of audio delay. The stimuli were the video recordings of a face of a female Japanese speaking long and short Japanese sentences. The intelligibility of the audio-visual stimuli was measured as a function of audio delays in sixteen untrained young subjects. Speech intelligibility under the audio-delay condition of less than 120 ms was significantly better than that under the audio-alone condition. On the other hand, the delay of 120 ms corresponded to the mean mora duration measured for the audio stimuli. The results implied that audio delays of up to 120 ms would not disrupt lip-reading advantage, because visual and auditory information in speech seemed to be integrated on a syllabic time scale. Potential applications of this research include noisy workplace in which a worker must extract relevant speech from all the other competing noises.

Citations

Jun 16, 2009·The Quarterly Journal of Experimental Psychology : QJEP·Toni CunilleraAntoni Rodriguez-Fornells

❮ Previous
Next ❯

Related Concepts

Related Feeds

Auditory Perception

Auditory perception is the ability to receive and interpret information attained by the ears. Here is the latest research on factors and underlying mechanisms that influence auditory perception.

Related Papers

The Journal of the Acoustical Society of America
M McGrath, Q Summerfield
Pró-fono : revista de atualização científica
Renata Rodrigues Moreira, Mario Ferreira Junior
The Journal of the Acoustical Society of America
Olha NahornaJean-Luc Schwartz
© 2022 Meta ULC. All rights reserved