How bodies and voices interact in early emotion perception.

PloS One
S JessenS A Kotz

Abstract

Successful social communication draws strongly on the correct interpretation of others' body and vocal expressions. Both can provide emotional information and often occur simultaneously. Yet their interplay has hardly been studied. Using electroencephalography, we investigated the temporal development underlying their neural interaction in auditory and visual perception. In particular, we tested whether this interaction qualifies as true integration following multisensory integration principles such as inverse effectiveness. Emotional vocalizations were embedded in either low or high levels of noise and presented with or without video clips of matching emotional body expressions. In both, high and low noise conditions, a reduction in auditory N100 amplitude was observed for audiovisual stimuli. However, only under high noise, the N100 peaked earlier in the audiovisual than the auditory condition, suggesting facilitatory effects as predicted by the inverse effectiveness principle. Similarly, we observed earlier N100 peaks in response to emotional compared to neutral audiovisual stimuli. This was not the case in the unimodal auditory condition. Furthermore, suppression of beta-band oscillations (15-25 Hz) primarily reflecting bio...Continue Reading

References

Apr 1, 1991·Journal of Clinical Neurophysiology : Official Publication of the American Electroencephalographic Society
Jan 1, 1999·Electroencephalography and Clinical Neurophysiology·S CochinJ Martineau
May 14, 1999·Trends in Cognitive Sciences·C Tallon-Baudry, O Bertrand
Jan 5, 2000·Human Brain Mapping·J P LachauxF J Varela
Feb 24, 2001·Proceedings of the National Academy of Sciences of the United States of America·J GrossR Salmelin
Jun 14, 2002·Brain Research. Cognitive Brain Research·Gilles PourtoisBeatrice de Gelder
Nov 20, 2003·Neuroreport·Daniel E CallanEric Vatikiotis-Bateson
Jul 9, 2004·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Ayse Pinar SayginMartin I Sereno
Jul 21, 2004·Neuron·Joost X MaierAsif A Ghazanfar
Jan 14, 2005·Proceedings of the National Academy of Sciences of the United States of America·Virginie van WassenhoveDavid Poeppel
Feb 16, 2005·Journal of Experimental Psychology. Human Perception and Performance·Fani LoulaMaggie Shiffrar
May 20, 2005·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Asif A GhazanfarNikos K Logothetis
Jun 1, 2005·Brain Research. Brain Research Reviews·Jaime A Pineda
Jul 1, 2005·Neuroinformatics·Michael S Beauchamp
Nov 2, 2005·Proceedings of the National Academy of Sciences of the United States of America·Hanneke K M MeerenBeatrice de Gelder
Dec 22, 2005·Journal of Experimental Psychology. Human Perception and Performance·Frank E PollickRebecca Stringer
Feb 24, 2006·Nature Reviews. Neuroscience·Beatrice de Gelder
Oct 4, 2006·Progress in Brain Research·Thomas EthoferDirk Wildgruber
Jan 17, 2007·Neuron·Peter LakatosCharles E Schroeder
Jul 31, 2007·Behavioural Brain Research·Erlinda R Ulloa, Jaime A Pineda
Aug 9, 2007·Emotion·Jan Van den StockBeatrice de Gelder
Sep 26, 2007·Journal of Cognitive Neuroscience·Jeroen J Stekelenburg, Jean Vroomen
Nov 13, 2007·Trends in Cognitive Sciences·Salvatore Campanella, Pascal Belin
Jan 11, 2008·Neuroreport·Silke Paulmann, Sonja A Kotz
May 23, 2008·Brain Research·Olivier CollignonFranco Lepore
Jul 1, 2008·Current Biology : CB·Joost X MaierAsif A Ghazanfar
Jul 12, 2008·Brain Research·Jan Van den StockBeatrice de Gelder
Oct 1, 2008·Psychophysiology·Suresh D Muthukumaraswamy, Krish D Singh
Oct 29, 2008·Neuroreport·Susanne DietrichHermann Ackermann
Nov 4, 2008·Social Neuroscience·Swann PichonJulie Grezes
Dec 2, 2008·Neuropsychologia·Céline CappeMicah M Murray
Mar 24, 2009·Journal of Cognitive Neuroscience·Disa Anna Sauter, Martin Eimer
Mar 28, 2009·Brain and Cognition·Antoine J ShahinLee M Miller
Jun 25, 2009·Experimental Brain Research·Barry E SteinBenjamin A Rowland

❮ Previous
Next ❯

Citations

Oct 30, 2015·Social Neuroscience·Violeta Enea, Sorina Iancu
Aug 25, 2015·Frontiers in Psychology·José M MestreGabriel G de la Torre
Jul 2, 2015·Social Cognitive and Affective Neuroscience·Xuhai ChenJiajin Yuan
May 26, 2015·Frontiers in Psychology·Lukasz PiwekKarin Petrini
Aug 26, 2014·Social Cognitive and Affective Neuroscience·Jenny KokinousErich Schröger
Jun 3, 2016·Frontiers in Human Neuroscience·Ashley E SymonsSonja A Kotz
Oct 23, 2016·Neuropsychologia·Pei-Wen YehVincent Reid
Feb 10, 2018·The Neuroscientist : a Review Journal Bringing Neurobiology, Neurology and Psychiatry·Julian Keil, Daniel Senkowski
Jul 7, 2017·Frontiers in Neuroscience·Zhihui PanXuhai Chen
Nov 8, 2013·Journal of Neurophysiology·Julian KeilMarc Schönwiesner
Nov 9, 2018·Frontiers in Human Neuroscience·Emmanuel Biau, Sonja A Kotz
Jan 4, 2019·Psychological Research·Rebecca Watson, Beatrice de Gelder
Feb 21, 2021·Research on Child and Adolescent Psychopathology·Nayra A Martin-KeyGraeme Fairchild
Nov 16, 2020·Progress in Neurobiology·Sascha Frühholz, Stefan R Schweinberger
May 19, 2017·Cortex; a Journal Devoted to the Study of the Nervous System and Behavior·Ana P PinheiroSonja A Kotz
Jun 17, 2020·Psychoneuroendocrinology·Adi LausenAnnekathrin Schacht

❮ Previous
Next ❯

Software Mentioned

Presentation
Motion
FieldTrip
Matlab
BrainVision Recorder

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.