Activations of deep convolutional neural networks are aligned with gamma band activity of human visual cortex

Communications Biology
Ilya KuzovkinJaan Aru

Abstract

Recent advances in the field of artificial intelligence have revealed principles about neural processing, in particular about vision. Previous work demonstrated a direct correspondence between the hierarchy of the human visual areas and layers of deep convolutional neural networks (DCNN) trained on visual object recognition. We use DCNN to investigate which frequency bands correlate with feature transformations of increasing complexity along the ventral visual pathway. By capitalizing on intracranial depth recordings from 100 patients we assess the alignment between the DCNN and signals at different frequency bands. We find that gamma activity (30-70 Hz) matches the increasing complexity of visual feature representations in DCNN. These findings show that the activity of the DCNN captures the essential characteristics of biological object recognition not only in space and time, but also in the frequency domain. These results demonstrate the potential that artificial intelligence algorithms have in advancing our understanding of the brain.

Citations

Mar 1, 1989·Proceedings of the National Academy of Sciences of the United States of America·C M Gray, W Singer
Jan 1, 1995·Annual Review of Neuroscience·W Singer, C M Gray
Apr 1, 1993·Current Opinion in Neurobiology·S Zeki
May 14, 1999·Trends in Cognitive Sciences·Catherine Tallon-Baudry, O Bertrand
Jan 5, 2000·Human Brain Mapping·Jean-Philippe LachauxF J Varela
Mar 30, 2001·Cerebral Cortex·Y LernerRafael Malach
Mar 22, 2002·NeuroImage·Christopher R GenoveseThomas Nichols
Jun 26, 2004·Annual Review of Neuroscience·Kalanit Grill-Spector, Rafael Malach
Sep 1, 2004·Trends in Cognitive Sciences·Christoph S HerrmannAndreas K Engel
Mar 24, 2005·NeuroImage·Jean-Philippe LachauxBernard Renault
Jun 30, 2006·Neural Networks : the Official Journal of the International Neural Network Society·Pablo A Estévez, Cristián J Figueroa
Mar 7, 2008·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Valentin Wyart, Catherine Tallon-Baudry
Nov 5, 2008·Frontiers in Neuroscience·Alexander Borst
Oct 30, 2009·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Jeremy R ManningMichael J Kahana
Jan 27, 2011·Frontiers in Human Neuroscience·Juan R VidalJean-Philippe Lachaux
May 3, 2011·PLoS Biology·Supratim Ray, John H R Maunsell
Feb 14, 2012·Neuron·James J DiCarloNicole C Rust
Mar 27, 2012·Annual Review of Neuroscience·György Buzsáki, Xiao-Jing Wang
May 9, 2014·Proceedings of the National Academy of Sciences of the United States of America·Daniel L K YaminsJames J DiCarlo
Sep 11, 2014·Proceedings of the National Academy of Sciences of the United States of America·Timo van KerkoerlePieter R Roelfsema
Nov 7, 2014·PLoS Computational Biology·Seyed-Mahdi Khaligh-Razavi, Nikolaus Kriegeskorte
Jul 11, 2015·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Umut Güçlü, Marcel A J van Gerven
Feb 26, 2016·Nature Neuroscience·Daniel L K Yamins, James J DiCarlo
Oct 26, 2016·NeuroImage·Michael EickenbergBertrand Thirion
Nov 24, 2015·Annual Review of Vision Science·Nikolaus Kriegeskorte
Jul 15, 2018·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Rishi RajalinghamJames J DiCarlo

Related Concepts

Visual System
Neuroma
Vision
Brain
Disorder of Visual Pathways
Intelligence
Anatomical Space Structure
Neural Network Simulation
Glutamate 5-kinase Activity
Intracranial

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Sexual Dimorphism in Neurodegeneration

There exist sex differences in neurodevelopmental and neurodegenerative disorders. For instance, multiple sclerosis is more common in women, whereas Parkinson’s disease is more common in men. Here is the latest research on sexual dimorphism in neurodegeneration

HLA Genetic Variation

HLA genetic variation has been found to confer risk for a wide variety of diseases. Identifying these associations and understanding their molecular mechanisms is ongoing and holds promise for the development of therapeutics. Find the latest research on HLA genetic variation here.

Super-resolution Microscopy

Super-resolution microscopy is the term commonly given to fluorescence microscopy techniques with resolutions that are not limited by the diffraction of light. Here are the latest discoveries pertaining to super-resolution microscopy.

Genetic Screens in iPSC-derived Brain Cells

Genetic screening is a critical tool that can be employed to define and understand gene function and interaction. This feed focuses on genetic screens conducted using induced pluripotent stem cell (iPSC)-derived brain cells.

Brain Lower Grade Glioma

Low grade gliomas in the brain form from oligodendrocytes and astrocytes and are the slowest-growing glioma in adults. Discover the latest research on these brain tumors here.

CD4/CD8 Signaling

Cluster of differentiation 4 and 8 (CD8 and CD8) are glycoproteins founds on the surface of immune cells. Here is the latest research on their role in cell signaling pathways.

Alignment-free Sequence Analysis Tools

Alignment-free sequence analyses have been applied to problems ranging from whole-genome phylogeny to the classification of protein families, identification of horizontally transferred genes, and detection of recombined sequences. Here is the latest research.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.