Beyond core object recognition: Recurrent processes account for object recognition under occlusion

PLoS Computational Biology
Karim RajaeiSeyed-Mahdi Khaligh-Razavi

Abstract

Core object recognition, the ability to rapidly recognize objects despite variations in their appearance, is largely solved through the feedforward processing of visual information. Deep neural networks are shown to achieve human-level performance in these tasks, and explain the primate brain representation. On the other hand, object recognition under more challenging conditions (i.e. beyond the core recognition problem) is less characterized. One such example is object recognition under occlusion. It is unclear to what extent feedforward and recurrent processes contribute in object recognition under occlusion. Furthermore, we do not know whether the conventional deep neural networks, such as AlexNet, which were shown to be successful in solving core object recognition, can perform similarly well in problems that go beyond the core recognition. Here, we characterize neural dynamics of object recognition under occlusion, using magnetoencephalography (MEG), while participants were presented with images of objects with various levels of occlusion. We provide evidence from multivariate analysis of MEG data, behavioral data, and computational modelling, demonstrating an essential role for recurrent processes in object recognition un...Continue Reading

References

Jan 1, 1991·Cerebral Cortex·D J Felleman, D C Van Essen
Sep 30, 1998·Current Opinion in Neurobiology·V A F LammeHenk Spekreijse
Nov 3, 1998·Vision Research·R A Rensink, J T Enns
Nov 14, 2000·Trends in Neurosciences·V A F Lamme, Pieter R Roelfsema
Mar 17, 2001·Science·S J Thorpe, Michèle Fabre-Thorpe
Nov 7, 2002·Journal of Cognitive Neuroscience·V A F LammeHenk Spekreijse
Aug 21, 2004·Neuroinformatics·Olaf Sporns, Jonathan D Zwi
Feb 26, 2005·Proceedings of the National Academy of Sciences of the United States of America·Anne H Weaver
Mar 4, 2005·Vision Research·Nadège Bacon-MacéSimon J Thorpe
Jul 27, 2005·Vision Research·Jeffrey S Johnson, Bruno A Olshausen
Apr 21, 2006·Psychological Science·Robert RauschenbergerSteven Yantis
Jul 18, 2006·Cerebral Cortex·Oliver J Hulme, S Zeki
Aug 8, 2006·Journal of Psychiatric Research·Jonathan K WynnMichael F Green
Sep 22, 2006·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Kristina J NielsenGregor Rainer
Apr 4, 2007·Proceedings of the National Academy of Sciences of the United States of America·Thomas SerreTomaso Poggio
Jul 17, 2007·Trends in Cognitive Sciences·James J DiCarlo, David Cox
Aug 24, 2007·Journal of Cognitive Neuroscience·J J FahrenfortV A F Lamme
Dec 19, 2007·Proceedings of the National Academy of Sciences of the United States of America·Marta I GarridoKarl J Friston
May 20, 2008·Journal of Vision·Jay HegdéDaniel Kersten
Sep 5, 2008·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Florian MormannChristof Koch
Feb 24, 2009·Vision Research·Juan ChenFang Fang
Sep 8, 2009·Journal of Human Evolution·Karin Isler, Carel P van Schaik
Jan 1, 2009·Frontiers in Neuroscience·Nikolaus Kriegeskorte
Jan 1, 2007·Advances in Cognitive Psychology·Stephen L Macknik, Susana Martinez-Conde
Jul 14, 2010·Journal of Cognitive Neuroscience·Alex ClarkeLorraine K Tyler
May 18, 2011·Computational Intelligence and Neuroscience·François TadelRichard M Leahy
Nov 22, 2011·Journal of Vision·Tomer Livne, Dov Sagi
Feb 14, 2012·Neuron·James J DiCarloNicole C Rust
Aug 22, 2012·Journal of Cognitive Neuroscience·Dean WyatteRandall C O'Reilly
Sep 29, 2012·Journal of Vision·Mauro ManassiMichael H Herzog
Apr 5, 2013·Frontiers in Psychology·Randall C O'ReillyDavid J Jilk
Apr 19, 2013·Nature Reviews. Neuroscience·Charles D Gilbert, Wu Li
Jul 24, 2013·Trends in Cognitive Sciences·Nikolaus Kriegeskorte, Rogier A Kievit
Aug 3, 2013·Journal of Vision·Thomas A CarlsonNikolaus Kriegeskorte
Oct 4, 2013·Journal of Neurophysiology·Leyla IsikTomaso Poggio
Oct 25, 2013·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Hiroshi BanYoshimichi Ejima
Jan 28, 2014·Nature Neuroscience·Radoslaw M CichyAude Oliva
Mar 7, 2014·Trends in Cognitive Sciences·J-R King, S Dehaene
Apr 4, 2014·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Alex Clarke, Lorraine K Tyler
Apr 20, 2014·PLoS Computational Biology·Hamed NiliNikolaus Kriegeskorte
May 9, 2014·Proceedings of the National Academy of Sciences of the United States of America·Daniel L K YaminsJames J DiCarlo
Jun 21, 2014·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Yoshito KosaiAnitha Pasupathy
Jul 30, 2014·Frontiers in Psychology·Dean WyatteRandall C O'Reilly
Aug 8, 2014·Frontiers in Computational Neuroscience·Masoud GhodratiSeyed-Mahdi Khaligh-Razavi
Nov 7, 2014·PLoS Computational Biology·Seyed-Mahdi Khaligh-Razavi, Nikolaus Kriegeskorte
Dec 19, 2014·PLoS Computational Biology·Charles F CadieuJames J DiCarlo
Mar 31, 2015·Frontiers in Psychology·Hulusi KafaligonulHaluk Öğmen
Jul 11, 2015·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Umut Güçlü, Marcel A J van Gerven
Sep 22, 2015·Frontiers in Neuroscience·Conrado A Bosman, Francisco Aboitiz
Apr 29, 2016·PLoS Computational Biology·Jonas KubiliusHans P Op de Beeck
May 3, 2016·Neural Networks : the Official Journal of the International Neural Network Society·Hiroshi YoshimuraTetsuya Akamatsu
Sep 8, 2016·Scientific Reports·Saeed R KheradpishehTimothée Masquelier
Sep 20, 2016·Frontiers in Computational Neuroscience·Saeed R KheradpishehTimothée Masquelier
Sep 25, 2016·NeuroImage·Gennady Erlikhman, Gideon P Caplovitz
Oct 30, 2016·Journal of Cognitive Neuroscience·Tim C KietzmannPeter König
Mar 17, 2017·Journal of Mathematical Psychology·Seyed-Mahdi Khaligh-RazaviNikolaus Kriegeskorte
Mar 23, 2018·Neural Computation·Hannah ChoiEric Shea-Brown
Aug 15, 2018·Proceedings of the National Academy of Sciences of the United States of America·Hanlin TangGabriel Kreiman

Citations

Feb 7, 2020·Journal of Cognitive Neuroscience·Grace Lindsay
Sep 2, 2020·ELife·Laura Gwilliams, Jean-Rémi King
Jul 25, 2020·PLoS Computational Biology·Noor SeijdelH S Scholte
Aug 28, 2020·Frontiers in Computational Neuroscience·Navid HasanzadehMilad Lankarany
Oct 9, 2019·Proceedings of the National Academy of Sciences of the United States of America·Tim C KietzmannNikolaus Kriegeskorte
May 20, 2020·BMC Neurology·Seyed-Mahdi Khaligh-RazaviSeyed Massood Nabavi
Nov 13, 2020·Nature Reviews. Neuroscience·Sadra Sadeh, Claudia Clopath
Mar 25, 2021·PLoS Computational Biology·Haider Al-Tahan, Yalda Mohsenzadeh

Methods Mentioned

BETA
feature extraction

Related Concepts

Brain
In Silico
Pattern Recognition, Visual
Photic Stimulation
Visual Perception
Magnetoencephalography
Familiarity
Local
Core
Recognition (Psychology)

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Alzheimer's Disease: MS4A

Variants within the membrane-spanning 4-domains subfamily A (MS4A) gene cluster have recently been implicated in Alzheimer's disease in genome-wide association studies. Here is the latest research on Alzheimer's disease and MS4A.

Pediculosis pubis

Pediculosis pubis is a disease caused by a parasitic insect known as Pthirus pubis, which infests human pubic hair, as well as other areas with hair including eye lashes. Here is the latest research.

Rh Isoimmunization

Rh isoimmunization is a potentially preventable condition that occasionally is associated with significant perinatal morbidity or mortality. Discover the latest research on Rh Isoimmunization here.

Genetic Screens in iPSC-derived Brain Cells

Genetic screening is a critical tool that can be employed to define and understand gene function and interaction. This feed focuses on genetic screens conducted using induced pluripotent stem cell (iPSC)-derived brain cells. It also follows CRISPR-Cas9 approaches to generating genetic mutants as a means of understanding the effect of genetics on phenotype.

Enzyme Evolution

This feed focuses on molecular models of enzyme evolution and new approaches (such as adaptive laboratory evolution) to metabolic engineering of microorganisms. Here is the latest research.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Pharmacology of Proteinopathies

This feed focuses on the pharmacology of proteinopathies - diseases in which proteins abnormally aggregate (i.e. Alzheimer’s, Parkinson’s, etc.). Discover the latest research in this field with this feed.

Alignment-free Sequence Analysis Tools

Alignment-free sequence analyses have been applied to problems ranging from whole-genome phylogeny to the classification of protein families, identification of horizontally transferred genes, and detection of recombined sequences. Here is the latest research.

Related Papers

BioRxiv : the Preprint Server for Biology
Karim RajaeiSeyed-Mahdi Khaligh-Razavi
BioRxiv : the Preprint Server for Biology
Courtney J SpoererNikolaus Kriegeskorte
Frontiers in Computational Neuroscience
Masoud GhodratiSeyed-Mahdi Khaligh-Razavi
© 2021 Meta ULC. All rights reserved