Face-voice space: Integrating visual and auditory cues in judgments of person distinctiveness

Attention, Perception & Psychophysics
Joshua R TatzWilliam Brent

Abstract

Faces and voices each convey multiple cues enabling us to tell people apart. Research on face and voice distinctiveness commonly utilizes multidimensional space to represent these complex, perceptual abilities. We extend this framework to examine how a combined face-voice space would relate to its constituent face and voice spaces. Participants rated videos of speakers for their dissimilarity in face only, voice only, and face-voice together conditions. Multiple dimensional scaling (MDS) and regression analyses showed that whereas face-voice space more closely resembled face space, indicating visual dominance, face-voice distinctiveness was best characterized by a multiplicative integration of face-only and voice-only distinctiveness, indicating that auditory and visual cues are used interactively in person-distinctiveness judgments. Further, the multiplicative integration could not be explained by the small correlation found between face-only and voice-only distinctiveness. As an exploratory analysis, we next identified auditory and visual features that correlated with the dimensions in the MDS solutions. Features pertaining to facial width, lip movement, spectral centroid, fundamental frequency, and loudness variation were id...Continue Reading

References

Jun 1, 1978·Journal of Speech and Hearing Research·B E WaldenD M Schwartz
Jul 1, 1978·The Journal of the Acoustical Society of America·S Singh, T Murry
Jun 1, 1992·Journal of Speech and Hearing Research·J KreimanG S Berke
May 1, 1992·The Quarterly Journal of Experimental Psychology. A, Human Experimental Psychology·T Valentine, M Endo
May 1, 1991·The Quarterly Journal of Experimental Psychology. A, Human Experimental Psychology·T Valentine
Jun 1, 1985·Journal of Experimental Child Psychology·L PedeltyS K Shevell
Nov 1, 1980·The Journal of the Acoustical Society of America·T Murry, S Singh
Aug 1, 1994·Journal of Speech and Hearing Research·J H Walton, R F Orlikoff
Oct 3, 2003·Current Biology : CB·Miyuki KamachiEric Vatikiotis-Bateson
Aug 11, 2004·Trends in Cognitive Sciences·Pascal BelinCatherine Bédard
Dec 8, 2004·Psychonomic Bulletin & Review·Graham Byatt, Gillian Rhodes
Dec 13, 2005·The Journal of the Acoustical Society of America·David R R Smith, Roy D Patterson
Apr 4, 2006·Neuropsychologia·Theresa CookeHeinrich H Bülthoff
Aug 19, 2007·Psychonomic Bulletin & Review·Timothy PotterGinwan Rhodes
Nov 13, 2007·Trends in Cognitive Sciences·Salvatore Campanella, Pascal Belin
Jan 26, 2008·Journal of Vision·Marc O Ernst
May 23, 2008·Brain Research·Olivier CollignonFranco Lepore
Nov 27, 2008·Psychological Research·Oliver Baumann, Pascal Belin
Apr 4, 2009·Journal of Experimental Child Psychology·Mayu NishimuraXiaoqing Gao
Jun 3, 2009·Journal of Experimental Psychology. Human Perception and Performance·Jason Haberman, David Whitney
May 27, 2010·Cognition·Megan H Papesh, Stephen D Goldinger
Oct 5, 2010·Journal of Vision·Nina GaissertHeinrich H Bülthoff
Jan 26, 2011·Attention, Perception & Psychophysics·Charles Spence
Jan 1, 2004·Ecological Psychology : a Publication of the International Society for Ecological Psychology·Lorin Lachs, David B Pisoni
Oct 20, 2011·Vision Research·Lun Zhao, Shlomo Bentin
Aug 23, 2012·Neuropsychologia·Saruchi ChhabraDoris Leung
Jan 2, 2013·Journal of Experimental Psychology. Human Perception and Performance·Lauren W Mavica, Elan Barenholtz
May 28, 2013·Current Biology : CB·Marianne LatinusPascal Belin
Jun 14, 2013·Psychological Science·Elise A PiazzaDavid Whitney
Jan 15, 2014·Psychonomic Bulletin & Review·Christian Wallraven
Apr 20, 2014·Journal of Vision·Waka FujisakiShin'ya Nishida
Jan 15, 2015·Cognition·I Bülthoff, F N Newell
Feb 6, 2015·Multimodal Brain Image Analysis : Second International Workshop, MBIA 2012, Held in Conjunction with MICCAI 2012, Nice, France, October 1-5, 2012 : Proceedings·Houwei CaoRagini Verma
Jul 17, 2015·Perspectives on Psychological Science : a Journal of the Association for Psychological Science·A Mike BurtonJürgen M Kaufmann
Jan 7, 2016·Attention, Perception & Psychophysics·Harriet M J SmithPaula C Stacey
Jan 19, 2017·The Journal of General Psychology·Zehra F PeynircioǧluJordan Wyatt
Oct 17, 2017·Annual Review of Psychology·Andrew J Oxenham
Jun 27, 2018·Psychonomic Bulletin & Review·Nadine LavanCarolyn McGettigan
Jul 3, 2019·Perception·David Brang

❮ Previous
Next ❯

Related Concepts

Related Feeds

Auditory Perception

Auditory perception is the ability to receive and interpret information attained by the ears. Here is the latest research on factors and underlying mechanisms that influence auditory perception.