Simple line drawings suffice for functional MRI decoding of natural scene categories

Proceedings of the National Academy of Sciences of the United States of America
Dirk B WaltherLi Fei-Fei

Abstract

Humans are remarkably efficient at categorizing natural scenes. In fact, scene categories can be decoded from functional MRI (fMRI) data throughout the ventral visual cortex, including the primary visual cortex, the parahippocampal place area (PPA), and the retrosplenial cortex (RSC). Here we ask whether, and where, we can still decode scene category if we reduce the scenes to mere lines. We collected fMRI data while participants viewed photographs and line drawings of beaches, city streets, forests, highways, mountains, and offices. Despite the marked difference in scene statistics, we were able to decode scene category from fMRI data for line drawings just as well as from activity for color photographs, in primary visual cortex through PPA and RSC. Even more remarkably, in PPA and RSC, error patterns for decoding from line drawings were very similar to those from color photographs. These data suggest that, in these regions, the information used to distinguish scene category is similar for line drawings and photographs. To determine the relative contributions of local and global structure to the human ability to categorize scenes, we selectively removed long or short contours from the line drawings. In a category-matching task...Continue Reading

References

Sep 1, 1976·Journal of Experimental Psychology. Human Learning and Memory·M C Potter
Jan 1, 1988·Cognitive Psychology·Irving Biederman, G Ju
Apr 1, 1982·Cognitive Psychology·Irving BiedermanJ C Rabinowitz
Jan 1, 1980·Annual Review of Psychology·R L De Valois, K K De Valois
Mar 1, 1980·Journal of Experimental Psychology. Human Learning and Memory·J G Snodgrass, M Vanderwart
May 1, 1993·The European Journal of Neuroscience·E Peterhans, R von der Heydt
Jun 1, 1996·Computers and Biomedical Research, an International Journal·R W Cox
Oct 1, 1996·Journal of Neurophysiology·Jack L GallantD C Van Essen
Apr 29, 1998·Nature·R Epstein, Nancy Kanwisher
May 20, 1998·Current Biology : CB·J M Wolfe
Nov 24, 1999·Journal of Neurophysiology·A Pasupathy, C E Connor
Feb 15, 2001·Journal of Cognitive Neuroscience·K M O'Craven, Nancy Kanwisher
Jun 22, 2002·Proceedings of the National Academy of Sciences of the United States of America·Fei Fei LiPietro Perona
Apr 27, 2005·Nature Neuroscience·Yukiyasu Kamitani, Frank Tong
Apr 28, 2007·Journal of Vision·Li Fei-FeiPietro Perona
Apr 29, 2009·Psychological Science·Michelle R Greene, Aude Oliva
May 19, 2009·Current Biology : CB·Sean P MacEvoy, Russell A Epstein
Aug 28, 2009·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Dirk B WaltherDiane M Beck

Citations

Sep 29, 2011·Nature Neuroscience·Marius V Peelen, Sabine Kastner
Jan 25, 2013·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Daniel D DilksNancy Kanwisher
Dec 6, 2012·Cerebral Cortex·Vanessa TroianiRussell A Epstein
Jun 26, 2014·Nature Reviews. Neuroscience·Kalanit Grill-Spector, Kevin S Weiner
Mar 11, 2016·Cortex; a Journal Devoted to the Study of the Nervous System and Behavior·Andrew S Persichetti, Daniel D Dilks
Apr 25, 2015·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society· Kai-Fu Yang Yong-Jie Li
Dec 3, 2014·Developmental Science·Moira R Dillon, Elizabeth S Spelke
Jun 25, 2014·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Lei ZhangLing Shao
Nov 25, 2014·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Yansheng MingXuming He
Mar 20, 2013·NeuroImage·Christopher BaldassanoLi Fei-Fei
Oct 30, 2014·Journal of Integrative Neuroscience·Mehdi Behroozi, Mohammad Reza Daliri
Jul 24, 2013·Trends in Cognitive Sciences·Nikolaus Kriegeskorte, Rogier A Kievit
Apr 4, 2013·Brain and Cognition·Sinéad L Mullally, Eleanor A Maguire
Jun 13, 2015·PloS One·Elissa M Aminoff, Michael J Tarr
Oct 23, 2016·Trends in Cognitive Sciences·George L MalcolmChris I Baker
Apr 2, 2013·Perspectives on Psychological Science : a Journal of the Association for Psychological Science·Mara MatherNancy Kanwisher
Apr 1, 2017·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Ravi Kiran SarvadevabhatlaR Venkatesh Babu
Oct 15, 2013·Cerebral Cortex·Fraser W Smith, Melvyn A Goodale
May 12, 2017·Journal of Cognitive Neuroscience·Eshed MargalitManan P Shah
Jan 11, 2017·Scientific Reports·Heeyoung ChooDirk B Walther
Jan 1, 2011·I-Perception·Sander Van de Cruys, Johan Wagemans
Jan 30, 2014·Psychological Science·Dirk B Walther, Dandan Shen
Apr 24, 2018·PLoS Computational Biology·Michael F Bonner, Russell A Epstein
Jan 27, 2017·Journal of Neurophysiology·Jeongho Park, Soojin Park
Aug 30, 2018·Hippocampus·Jessica RobinRosanna K Olsen
Jan 25, 2019·Journal of Vision·Anna Shafer-Skelton, Timothy F Brady
Oct 2, 2019·Proceedings of the National Academy of Sciences of the United States of America·Andrew S Persichetti, Daniel D Dilks
Sep 8, 2018·Attention, Perception & Psychophysics·Claudia DamianoDirk B Walther
Jul 19, 2019·Brain Structure & Function·Merim BilalićLuca Turella
Jan 4, 2017·Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences·Iris I A GroenChris I Baker
Apr 19, 2017·Proceedings of the National Academy of Sciences of the United States of America·Michael F Bonner, Russell A Epstein
Jun 27, 2017·Frontiers in Human Neuroscience·Elisa FilevichSimone Kühn
Aug 21, 2018·Cognitive Science·Judith E FanNicholas B Turk-Browne
Aug 4, 2018·Journal of Vision·John WilderDirk B Walther
Nov 19, 2019·Vision·Carrick C Williams, Monica S Castelhano
Jan 30, 2020·Scientific Reports·Yoshiaki TsushimaKazuteru Komine

Related Concepts

Functional Cerebral Localization
Insula of Reil
Magnetization Transfer Contrast Imaging
Pattern Recognition, Visual
Photic Stimulation
Reaction Time
Visual Cortex
Visual Perception
Parahippocampal Gyrus
Magnetic Resonance Imaging

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Synthetic Genetic Array Analysis

Synthetic genetic arrays allow the systematic examination of genetic interactions. Here is the latest research focusing on synthetic genetic arrays and their analyses.

Congenital Hyperinsulinism

Congenital hyperinsulinism is caused by genetic mutations resulting in excess insulin secretion from beta cells of the pancreas. Here is the latest research.

Neural Activity: Imaging

Imaging of neural activity in vivo has developed rapidly recently with the advancement of fluorescence microscopy, including new applications using miniaturized microscopes (miniscopes). This feed follows the progress in this growing field.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Epigenetic Memory

Epigenetic memory refers to the heritable genetic changes that are not explained by the DNA sequence. Find the latest research on epigenetic memory here.

Cell Atlas of the Human Eye

Constructing a cell atlas of the human eye will require transcriptomic and histologic analysis over the lifespan. This understanding will aid in the study of development and disease. Find the latest research pertaining to the Cell Atlas of the Human Eye here.

Femoral Neoplasms

Femoral Neoplasms are bone tumors that arise in the femur. Discover the latest research on femoral neoplasms here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.