Apr 30, 2020

Rapid invisible frequency tagging reveals nonlinear integration of auditory and visual semantic information

BioRxiv : the Preprint Server for Biology
Linda DrijversO. Jensen

Abstract

During communication in real-life settings, the brain integrates information from auditory and visual modalities to form a unified percept of our environment. In the current magnetoencephalography (MEG) study, we used rapid invisible frequency tagging (RIFT) to generate steady-state evoked fields and investigated the integration of audiovisual information in a semantic context. We presented participants with videos of an actress uttering action verbs (auditory; tagged at 61 Hz) accompanied by a gesture (visual; tagged at 68 Hz, using a projector with a 1440 Hz refresh rate). Integration ease was manipulated by auditory factors (clear/degraded speech) and visual factors (congruent/incongruent gesture). We identified MEG spectral peaks at the individual (61/68 Hz) tagging frequencies. We furthermore observed a peak at the intermodulation frequency of the auditory and visually tagged signals (fvisual - fauditory = 7 Hz), specifically when integration was easiest (i.e., when speech was clear and accompanied by a congruent gesture). This intermodulation peak is a signature of nonlinear audiovisual integration, and was strongest in left inferior frontal gyrus and left temporal regions; areas known to be involved in speech-gesture int...Continue Reading

  • References
  • Citations

References

  • We're still populating references for this paper, please check back later.
  • References
  • Citations

Citations

  • This paper may not have been cited yet.

Mentioned in this Paper

Neuron Differentiation
Transcriptional Regulation
Ataxia as Late Effect of Cerebrovascular Disease
Transcription, Genetic
Neurons
Trans-Activation, Genetic
Gene Expression
Evaluation
Cell Differentiation Process
NEUROD1

Related Feeds

Ataxia

Ataxia is a neurological condition characterized by lack of voluntary coordination of muscle movements including loss of coordination, balance, and speech. Discover the latest research on ataxia here.

BioRxiv & MedRxiv Preprints

BioRxiv and MedRxiv are the preprint servers for biology and health sciences respectively, operated by Cold Spring Harbor Laboratory. Here are the latest preprint articles (which are not peer-reviewed) from BioRxiv and MedRxiv.

Ataxias (MDS)

Ataxia is a neurological condition characterized by lack of voluntary coordination of muscle movements including loss of coordination, balance, and speech. Discover the latest research on ataxia here.

Ataxias

Ataxia is a neurological condition characterized by lack of voluntary coordination of muscle movements including loss of coordination, balance, and speech. Discover the latest research on ataxia here.