Deep Learning: The Good, the Bad, and the Ugly

Annual Review of Vision Science
Thomas Serre


Artificial vision has often been described as one of the key remaining challenges to be solved before machines can act intelligently. Recent developments in a branch of machine learning known as deep learning have catalyzed impressive gains in machine vision-giving a sense that the problem of vision is getting closer to being solved. The goal of this review is to provide a comprehensive overview of recent deep learning developments and to critically assess actual progress toward achieving human-level visual intelligence. I discuss the implications of the successes and limitations of modern machine vision algorithms for biological vision and the prospect for neuroscience to inform the design of future artificial vision systems.


Jan 12, 1989·Nature·F Crick
Dec 1, 1987·Journal of Neurophysiology·J P Jones, L A Palmer
Apr 1, 1987·Psychological Review·Irving Biederman
Feb 1, 1985·Journal of the Optical Society of America. A, Optics and Image Science·E H Adelson, J R Bergen
Jan 1, 1972·Journal of Neurophysiology·C G GrossD B Bender
May 1, 1995·Current Biology : CB·N K LogothetisTomaso Poggio
Jan 23, 1996·Proceedings of the National Academy of Sciences of the United States of America·D J HeegerJ A Movshon
Oct 23, 1997·Neural Computation·S Hochreiter, Jürgen Schmidhuber
Nov 3, 1998·Vision Research·T S LeeV A Lamme
Oct 20, 1999·Nature Neuroscience·M Riesenhuber, Tomaso Poggio
Mar 4, 2003·Nature Reviews. Neuroscience·Martin A Giese, Tomaso Poggio
Nov 7, 2009·Psychological Science·Yuri OstrovskyPawan Sinha
Oct 19, 2011·Proceedings of the National Academy of Sciences of the United States of America·François FleuretDonald Geman
Feb 14, 2012·Neuron·James J DiCarloNicole C Rust
Mar 6, 2012·Neural Networks : the Official Journal of the International Neural Network Society·Dan CireşanJürgen Schmidhuber
May 11, 2012·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Nuo Li, James J DiCarlo
May 9, 2014·Proceedings of the National Academy of Sciences of the United States of America·Daniel L K YaminsJames J DiCarlo
Nov 7, 2014·PLoS Computational Biology·Seyed-Mahdi Khaligh-Razavi, Nikolaus Kriegeskorte
Dec 19, 2014·PLoS Computational Biology·Charles F CadieuJames J DiCarlo
Feb 27, 2015·Nature·Volodymyr MnihDemis Hassabis
Jul 11, 2015·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Umut Güçlü, Marcel A J van Gerven
Aug 19, 2015·Current Opinion in Neurobiology·Susumu TonegawaTomás J Ryan
Oct 20, 2015·NeuroImage·Maxime CauchoixThomas Serre
Oct 27, 2015·PLoS Computational Biology·Tobias BroschPieter R Roelfsema
Jan 29, 2016·Nature·David SilverDemis Hassabis
Feb 18, 2016·Proceedings of the National Academy of Sciences of the United States of America·Shimon UllmanDaniel Harari
Feb 26, 2016·Nature Neuroscience·Daniel L K Yamins, James J DiCarlo
Apr 29, 2016·PLoS Computational Biology·Jonas KubiliusHans P Op de Beeck
Jun 28, 2016·PLoS Computational Biology·Ján AntolíkThomas D Mrsic-Flogel
Jul 16, 2016·Science·Antone Martinho, Alex Kacelnik
Sep 8, 2016·Scientific Reports·Saeed R KheradpishehTimothée Masquelier
Sep 20, 2016·Frontiers in Computational Neuroscience·Saeed R KheradpishehTimothée Masquelier
Oct 13, 2016·Nature·Alex GravesDemis Hassabis
Oct 26, 2016·NeuroImage·Michael EickenbergBertrand Thirion
Jan 7, 2017·IEEE Transactions on Pattern Analysis and Machine Intelligence·Vijay BadrinarayananRoberto Cipolla
Feb 16, 2017·Frontiers in Computational Neuroscience·Tomoyasu Horikawa, Yukiyasu Kamitani
Mar 17, 2017·Journal of Mathematical Psychology·Seyed-Mahdi Khaligh-RazaviNikolaus Kriegeskorte
May 4, 2017·IEEE Transactions on Pattern Analysis and Machine Intelligence·Liang-Chieh ChenAlan L Yuille
May 6, 2017·IEEE Transactions on Pattern Analysis and Machine Intelligence·Kevis-Kokitsi ManinisLuc Van Gool
May 20, 2017·Frontiers in Computational Neuroscience·Benjamin Scellier, Yoshua Bengio
May 23, 2017·Nature Communications·Tomoyasu Horikawa, Yukiyasu Kamitani
Nov 24, 2015·Annual Review of Vision Science·Nikolaus Kriegeskorte
Jun 30, 2017·ENeuro·Ioannis KalfasRufin Vogels
Jul 21, 2017·Neuron·Demis HassabisMatt Botvinick
Sep 12, 2017·Current Biology : CB·Miguel P EcksteinEmre Akbas
Sep 15, 2017·Psychological Review·Goker Erdogan, Robert A Jacobs
Sep 20, 2017·Current Opinion in Neurobiology·Leon A GatysMatthias Bethge
Sep 29, 2017·Frontiers in Psychology·Courtney J SpoererNikolaus Kriegeskorte
Oct 21, 2017·Nature·David SilverDemis Hassabis
Mar 30, 2018·Nature·Marwin H S SeglerMark P Waller
May 31, 2018·Proceedings of the National Academy of Sciences of the United States of America·P Jonathon PhillipsAlice J O'Toole
Jun 16, 2018·Science·S M Ali EslamiDemis Hassabis
Jul 15, 2018·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Rishi RajalinghamJames J DiCarlo
Jul 25, 2018·IEEE Transactions on Pattern Analysis and Machine Intelligence·Bolei ZhouAntonio Torralba
Jul 25, 2018·PLoS Computational Biology·Michelle R Greene, Bruce C Hansen
Aug 3, 2018·Nature·Alexander RadovicTaritree Wongjirad
Aug 15, 2018·Proceedings of the National Academy of Sciences of the United States of America·Hanlin TangGabriel Kreiman
Aug 22, 2018·Nature Neuroscience·Alexander MathisMatthias Bethge
Aug 24, 2018·PLoS Computational Biology·Niru MaheswaranathanSurya Ganguli
Sep 5, 2018·Cognitive Science·Joshua C PetersonThomas L Griffiths
Sep 7, 2018·Nature Biotechnology·Michael WainbergBrendan J Frey
Dec 12, 2018·PLoS Computational Biology·Nicholas BakerPhilip J Kellman
Mar 25, 2019·Nature Communications·Zhenglong Zhou, Chaz Firestone
Apr 24, 2019·PLoS Computational Biology·Santiago A CadenaAlexander S Ecker
Apr 30, 2019·IEEE Transactions on Pattern Analysis and Machine Intelligence·Jie HuEnhua Wu
May 1, 2019·Nature Neuroscience·Olivier J HénaffEero P Simoncelli
May 3, 2019·Science·Pouya BashivanJames J DiCarlo


Aug 7, 2019·Annual Review of Vision Science·Daniel A Butts
Feb 7, 2020·Journal of Cognitive Neuroscience·Grace Lindsay
Mar 1, 2020·Annals of the New York Academy of Sciences·Gabriel Kreiman, Thomas Serre
Jul 22, 2020·PLoS Computational Biology·Adrien DoerigMichael H Herzog
Oct 1, 2020·Computational and Structural Biotechnology Journal·Erik Meijering

Related Concepts

Artificial Vision

Trending Feeds


Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Synthetic Genetic Array Analysis

Synthetic genetic arrays allow the systematic examination of genetic interactions. Here is the latest research focusing on synthetic genetic arrays and their analyses.

Neural Activity: Imaging

Imaging of neural activity in vivo has developed rapidly recently with the advancement of fluorescence microscopy, including new applications using miniaturized microscopes (miniscopes). This feed follows the progress in this growing field.

Computational Methods for Protein Structures

Computational methods employing machine learning algorithms are powerful tools that can be used to predict the effect of mutations on protein structure. This is important in neurodegenerative disorders, where some mutations can cause the formation of toxic protein aggregations. This feed follows the latests insights into the relationships between mutation and protein structure leading to better understanding of disease.

Congenital Hyperinsulinism

Congenital hyperinsulinism is caused by genetic mutations resulting in excess insulin secretion from beta cells of the pancreas. Here is the latest research.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Epigenetic Memory

Epigenetic memory refers to the heritable genetic changes that are not explained by the DNA sequence. Find the latest research on epigenetic memory here.

Cell Atlas of the Human Eye

Constructing a cell atlas of the human eye will require transcriptomic and histologic analysis over the lifespan. This understanding will aid in the study of development and disease. Find the latest research pertaining to the Cell Atlas of the Human Eye here.

Femoral Neoplasms

Femoral Neoplasms are bone tumors that arise in the femur. Discover the latest research on femoral neoplasms here.

Related Papers

Annual Review of Vision Science
Jaclyn M Durkin, Sara J Aton
Annual Review of Vision Science
Aurelien DavidLorne Whitehead
Annual Review of Food Science and Technology
Janina A KrumbeckRobert W Hutkins
© 2021 Meta ULC. All rights reserved