Modelling the perceptual similarity of facial expressions from image statistics and neural responses

NeuroImage
Mladen SormazTimothy J Andrews

Abstract

The ability to perceive facial expressions of emotion is essential for effective social communication. We investigated how the perception of facial expression emerges from the image properties that convey this important social signal, and how neural responses in face-selective brain regions might track these properties. To do this, we measured the perceptual similarity between expressions of basic emotions, and investigated how this is reflected in image measures and in the neural response of different face-selective regions. We show that the perceptual similarity of different facial expressions (fear, anger, disgust, sadness, happiness) can be predicted by both surface and feature shape information in the image. Using block design fMRI, we found that the perceptual similarity of expressions could also be predicted from the patterns of neural response in the face-selective posterior superior temporal sulcus (STS), but not in the fusiform face area (FFA). These results show that the perception of facial expression is dependent on the shape and surface properties of the image and on the activity of specific face-selective regions.

References

Sep 1, 1992·Cognition·N L Etcoff, J J Magee
Jun 1, 1994·Cortex; a Journal Devoted to the Study of the Nervous System and Behavior·S MagnussenS Dyrnes
May 29, 2000·Trends in Cognitive Sciences·J V HaxbyM I Gobbini
Jun 22, 2000·Trends in Cognitive Sciences·T AllisonG McCarthy
Apr 9, 2001·Vision Research·A J CalderS Akamatsu
Oct 4, 2005·Cognitive Psychology·A Mike BurtonDavid White
Jan 27, 2007·Journal of Neuroscience Methods·Jonathan W Peirce
Aug 21, 2007·Neuropsychologia·Andrew D Engell, James V Haxby
Dec 8, 2007·NeuroImage·Alumit Ishai
Dec 22, 2007·Brain Research·Andrea ButlerJason J S Barton
Jan 17, 2008·Perception·Richard Russell, Pawan Sinha
Dec 24, 2008·Frontiers in Systems Neuroscience·Nikolaus KriegeskortePeter Bandettini
Nov 17, 2009·Perception·Christopher P Benton
Jan 1, 2009·Frontiers in Neuroscience·Nikolaus Kriegeskorte
Jul 10, 2010·Journal of Vision·Christopher P SaidJames V Haxby
Dec 6, 2012·Proceedings of the National Academy of Sciences of the United States of America·Richard J HarrisTimothy J Andrews
Nov 7, 2013·Frontiers in Human Neuroscience·Bronson HarryJeesun Kim
Jul 6, 2014·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·David Pitcher
Jun 6, 2015·Cortex; a Journal Devoted to the Study of the Nervous System and Behavior·Martin WegrzynJohanna Kissler

❮ Previous
Next ❯

Citations

Feb 21, 2018·The Quarterly Journal of Experimental Psychology : QJEP·Andrew W Young
Apr 23, 2017·Scientific Reports·Camille Daudelin-PeltierDaniel Fiset
Jul 24, 2021·Cerebral Cortex Communications·Runnan CaoShuo Wang

❮ Previous
Next ❯

Related Concepts

Related Feeds

Amygdala and Midbrain Dopamine

The midbrain dopamine system is widely studied for its involvement in emotional and motivational behavior. Some of these neurons receive information from the amygdala and project throughout the cortex. When the circuit and transmission of dopamine is disrupted symptoms may present. Here is the latest research on the amygdala and midbrain dopamine.

Amygdala: Sensory Processes

Amygdalae, nuclei clusters located in the temporal lobe of the brain, play a role in memory, emotional responses, and decision-making. Here is the latest research on sensory processes in the amygdala.

© 2021 Meta ULC. All rights reserved