Common Object Representations for Visual Production and Recognition

Cognitive Science
Judith FanNicholas Turk-Browne

Abstract

Production and comprehension have long been viewed as inseparable components of language. The study of vision, by contrast, has centered almost exclusively on comprehension. Here we investigate drawing-the most basic form of visual production. How do we convey concepts in visual form, and how does refining this skill, in turn, affect recognition? We developed an online platform for collecting large amounts of drawing and recognition data, and applied a deep convolutional neural network model of visual cortex trained only on natural images to explore the hypothesis that drawing recruits the same abstract feature representations that support natural visual object recognition. Consistent with this hypothesis, higher layers of this model captured the abstract features of both drawings and natural images most important for recognition, and people learning to produce more recognizable drawings of objects exhibited enhanced recognition of those objects. These findings could explain why drawing is so effective for communicating visual concepts, they suggest novel approaches for evaluating and refining conceptual knowledge, and they highlight the potential of deep networks for understanding human learning.

References

Jan 1, 1992·Trends in Neurosciences·M A Goodale, A D Milner
Dec 1, 1991·Research Quarterly for Exercise and Sport·C A Wrisberg, Z Liu
Jan 1, 1988·Cognitive Psychology·I Biederman, G Ju
Jan 1, 1972·Journal of Neurophysiology·C G GrossD B Bender
Mar 1, 1968·The Journal of Physiology·D H Hubel, T N Wiesel
Feb 29, 1980·Proceedings of the Royal Society of London. Series B, Containing Papers of a Biological Character·D Marr, E Hildreth
Jun 1, 1983·Journal of Experimental Child Psychology·A M Davis
Mar 13, 1998·Annual Review of Psychology·R L Goldstone
Aug 17, 2001·Journal of Cognitive Neuroscience·A IshaiJ V Haxby
Mar 26, 2002·Trends in Cognitive Sciences·Rafael MalachUri Hasson
Nov 8, 2005·Science·Chou P HungJames J DiCarlo
Jun 13, 2006·Neural Computation·Kenneth NormanSean Polyn
Jan 16, 2007·Science·Brendan J Frey, Delbert Dueck
Mar 24, 2007·Current Opinion in Neurobiology·Marvin M Chun, Nicholas Turk-Browne
Feb 16, 2008·Science·Jeffrey D Karpicke, Henry L Roediger
Mar 7, 2008·Nature·Kendrick N KayJack L Gallant
Dec 27, 2008·Neuron·Nikolaus KriegeskortePeter A Bandettini
Feb 17, 2009·Current Biology : CB·Daniel A BraunCarsten Mehring
Jun 26, 2009·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Melina R Uncapher, Michael D Rugg
Mar 1, 1998·Trends in Cognitive Sciences·G Vallar
May 14, 2011·Cognitive Science·Nicolas FayNik Swoboda
May 20, 2011·Proceedings of the National Academy of Sciences of the United States of America·Dirk B WaltherLi Fei-Fei
Nov 12, 2007·Cognitive Science·Simon GarrodTracy Macleod
Sep 10, 2005·Cognitive Science·Bruno Galantucci
Oct 29, 2011·Nature Reviews. Neuroscience·Daniel M WolpertJ Randall Flanagan
Nov 9, 2011·Frontiers in Human Neuroscience·Bilge Sayim, Patrick Cavanagh
Feb 14, 2012·Neuron·James J DiCarloNicole C Rust
Jun 16, 2012·Science·A W G PikeJ Zilhão
Oct 12, 2012·Journal of Neurophysiology·Jordan A TaylorRichard B Ivry
Oct 27, 2012·Cognitive Psychology·Joseph J Williams, Tania Lombrozo
Dec 14, 2012·The Quarterly Journal of Experimental Psychology : QJEP·Rebecca ChamberlainNicola Brunswick
Aug 21, 2013·Cognition·Judith Fan, Nicholas Turk-Browne
May 9, 2014·Proceedings of the National Academy of Sciences of the United States of America·Daniel YaminsJames J DiCarlo
Jul 1, 2011·Topics in Cognitive Science·Barbara Tversky
Oct 10, 2014·Nature·M AubertA Dosseto
Oct 31, 2014·Journal of Neurophysiology·Ali A Nikooyan, Alaa A Ahmed
Nov 7, 2014·PLoS Computational Biology·Seyed-Mahdi Khaligh-Razavi, Nikolaus Kriegeskorte
Dec 4, 2014·I-Perception·Florian Perdreau, Patrick Cavanagh
Jun 13, 2015·Journal of Vision·Florian Perdreau, Patrick Cavanagh
Jul 11, 2015·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Umut Güçlü, Marcel A J van Gerven
Dec 15, 2015·Science·Brenden M LakeJoshua B Tenenbaum
Apr 29, 2016·PLoS Computational Biology·Jonas KubiliusHans P Op de Beeck

Related Concepts

Learning
Persons
Vision
Visual Cortex
Depth
Evaluation
Recognition (Psychology)
Neural Network Simulation
Study

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Synthetic Genetic Array Analysis

Synthetic genetic arrays allow the systematic examination of genetic interactions. Here is the latest research focusing on synthetic genetic arrays and their analyses.

Congenital Hyperinsulinism

Congenital hyperinsulinism is caused by genetic mutations resulting in excess insulin secretion from beta cells of the pancreas. Here is the latest research.

Neural Activity: Imaging

Imaging of neural activity in vivo has developed rapidly recently with the advancement of fluorescence microscopy, including new applications using miniaturized microscopes (miniscopes). This feed follows the progress in this growing field.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Epigenetic Memory

Epigenetic memory refers to the heritable genetic changes that are not explained by the DNA sequence. Find the latest research on epigenetic memory here.

Cell Atlas of the Human Eye

Constructing a cell atlas of the human eye will require transcriptomic and histologic analysis over the lifespan. This understanding will aid in the study of development and disease. Find the latest research pertaining to the Cell Atlas of the Human Eye here.

Femoral Neoplasms

Femoral Neoplasms are bone tumors that arise in the femur. Discover the latest research on femoral neoplasms here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Related Papers

BioRxiv : the Preprint Server for Biology
Espen Moen EilertsenE. Ystrom
BioRxiv : the Preprint Server for Biology
Judith FanNicholas Turk-Browne
Proceedings of the National Academy of Sciences of the United States of America
Shimon UllmanDaniel Harari
© 2021 Meta ULC. All rights reserved