Abstract
The ability to perceive facial expressions of emotion is essential for effective social communication. We investigated how the perception of facial expression emerges from the image properties that convey this important social signal, and how neural responses in face-selective brain regions might track these properties. To do this, we measured the perceptual similarity between expressions of basic emotions, and investigated how this is reflected in image measures and in the neural response of different face-selective regions. We show that the perceptual similarity of different facial expressions (fear, anger, disgust, sadness, happiness) can be predicted by both surface and feature shape information in the image. Using block design fMRI, we found that the perceptual similarity of expressions could also be predicted from the patterns of neural response in the face-selective posterior superior temporal sulcus (STS), but not in the fusiform face area (FFA). These results show that the perception of facial expression is dependent on the shape and surface properties of the image and on the activity of specific face-selective regions.
References
Sep 1, 1992·Cognition·N L Etcoff, J J Magee
Jun 1, 1994·Cortex; a Journal Devoted to the Study of the Nervous System and Behavior·S MagnussenS Dyrnes
May 29, 2000·Trends in Cognitive Sciences·J V HaxbyM I Gobbini
Jun 22, 2000·Trends in Cognitive Sciences·T AllisonG McCarthy
Apr 9, 2001·Vision Research·A J CalderS Akamatsu
Sep 29, 2001·Science·J V HaxbyP Pietrini
Oct 2, 2001·Perception·M White
Jul 24, 2003·Brain : a Journal of Neurology·Bruno RossionEugene Mayer
Apr 30, 2004·Journal of Neurophysiology·J S WinstonR J Dolan
Oct 4, 2005·Cognitive Psychology·A Mike BurtonDavid White
Jan 27, 2007·Journal of Neuroscience Methods·Jonathan W Peirce
Aug 21, 2007·Neuropsychologia·Andrew D Engell, James V Haxby
Dec 8, 2007·NeuroImage·Alumit Ishai
Dec 22, 2007·Brain Research·Andrea ButlerJason J S Barton
Jan 17, 2008·Perception·Richard Russell, Pawan Sinha
Oct 15, 2008·NeuroImage·Christopher J FoxJason J S Barton
Dec 24, 2008·Frontiers in Systems Neuroscience·Nikolaus KriegeskortePeter Bandettini
Nov 17, 2009·Perception·Christopher P Benton
Jan 1, 2009·Frontiers in Neuroscience·Nikolaus Kriegeskorte
Jul 10, 2010·Journal of Vision·Christopher P SaidJames V Haxby
Nov 23, 2012·Cerebral Cortex·Heidi A BaselerTimothy J Andrews
Dec 6, 2012·Proceedings of the National Academy of Sciences of the United States of America·Richard J HarrisTimothy J Andrews
Nov 7, 2013·Frontiers in Human Neuroscience·Bronson HarryJeesun Kim
Nov 23, 2013·Psychological Science·Lilia PsaltaTimothy J Andrews
Dec 18, 2013·Journal of Vision·Pamela M Pallett, Ming Meng
Apr 22, 2014·NeuroImage·Richard J HarrisTimothy J Andrews
Jul 6, 2014·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·David Pitcher
Jun 6, 2015·Cortex; a Journal Devoted to the Study of the Nervous System and Behavior·Martin WegrzynJohanna Kissler
Citations
Feb 21, 2018·The Quarterly Journal of Experimental Psychology : QJEP·Andrew W Young
Jan 30, 2018·Frontiers in Human Neuroscience·Xiaoli YangBaolin Liu
Jul 25, 2019·Human Brain Mapping·David D CogganTimothy J Andrews
Sep 13, 2020·Cognitive, Affective & Behavioral Neuroscience·Qiuling Luo, Milena Dzhelyova
Apr 23, 2017·Scientific Reports·Camille Daudelin-PeltierDaniel Fiset
Jul 24, 2021·Cerebral Cortex Communications·Runnan CaoShuo Wang