Sparse coding with an overcomplete basis set: a strategy employed by V1?

Vision Research
B A Olshausen, D J Field

Abstract

The spatial receptive fields of simple cells in mammalian striate cortex have been reasonably well described physiologically and can be characterized as being localized, oriented, and bandpass, comparable with the basis functions of wavelet transforms. Previously, we have shown that these receptive field properties may be accounted for in terms of a strategy for producing a sparse distribution of output activity in response to natural images. Here, in addition to describing this work in a more expansive fashion, we examine the neurobiological implications of sparse coding. Of particular interest is the case when the code is overcomplete--i.e., when the number of code elements is greater than the effective dimensionality of the input space. Because the basis functions are non-orthogonal and not linearly independent of each other, sparsifying the code will recruit only those basis functions necessary for representing a given input, and so the input-output function will deviate from being purely linear. These deviations from linearity provide a potential explanation for the weak forms of non-linearity observed in the response properties of cortical simple cells, and they further make predictions about the expected interactions amo...Continue Reading

References

Jan 1, 1989·IEEE Transactions on Bio-medical Engineering·J G Daugman
Apr 1, 1988·Journal of the Optical Society of America. A, Optics and Image Science·A J Parker, M J Hawken
Dec 1, 1987·Journal of the Optical Society of America. A, Optics and Image Science·D J Field
Jan 1, 1982·Vision Research·R L De ValoisL G Thorell
Sep 1, 1995·Neural Computation·P DayanR S Zemel
Nov 1, 1995·Neural Computation·A J Bell, T J Sejnowski
Aug 2, 1994·Proceedings of the National Academy of Sciences of the United States of America·C C Law, L N Cooper
Jun 13, 1996·Nature·R Baddeley
Aug 29, 1997·Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences·G E Hinton, Z Ghahramani
May 1, 1996·Network : Computation in Neural Systems·G F Harpur, R W Prager
May 1, 1996·Network : Computation in Neural Systems·B A Olshausen, D J Field

❮ Previous
Next ❯

Citations

Oct 28, 2005·Journal of Comparative Physiology. A, Neuroethology, Sensory, Neural, and Behavioral Physiology·Anthony Leonardo
Dec 15, 2004·Biological cybernetics·Li Zhao
Sep 12, 2006·Biological cybernetics·Simon Durrant, Jianfeng Feng
Oct 21, 2006·Journal of Computational Neuroscience·Martin Rehn, Friedrich T Sommer
Nov 13, 2008·Cognitive Neurodynamics·Sheng Li, Si Wu
Jul 10, 2004·Journal of Physiology, Paris·Antonio Turiel, Néstor Parga
Jan 9, 2003·Trends in Cognitive Sciences·Nick Chater, Paul Vitányi
Mar 25, 2009·Visual Neuroscience·Constantin A Rothkopf, Dana H Ballard
Jul 6, 2004·Nature Neuroscience·Scott L Brincat, Charles E Connor
Mar 6, 2002·The European Journal of Neuroscience·Wolfgang EinhäuserKonrad P Körding
Jan 19, 2010·Proceedings of the National Academy of Sciences of the United States of America·James M HughesDaniel N Rockmore
Mar 9, 2011·Proceedings of the National Academy of Sciences of the United States of America·Dale PurvesR Beau Lotto
Aug 15, 2012·Proceedings of the National Academy of Sciences of the United States of America·Bryan C DanielsJessica C Flack
May 9, 1998·Proceedings of the National Academy of Sciences of the United States of America·E M Callaway
Oct 3, 2000·Network : Computation in Neural Systems·P O Hoyer, A Hyvärinen
Aug 27, 2003·Network : Computation in Neural Systems·Zhiyong Yang, Dale Purves
Aug 27, 2003·Network : Computation in Neural Systems·Yan Karklin, Michael S Lewicki
Aug 27, 2003·Network : Computation in Neural Systems·Roberto Valerio, Rafael Navarro
Dec 23, 1998·Network : Computation in Neural Systems·R P Rao, D H Ballard
Apr 30, 1999·Network : Computation in Neural Systems·C J Webber
Apr 2, 1998·Proceedings. Biological Sciences·J H van Hateren, A van der Schaaf
May 25, 2002·Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences·Wilson S Geisler, Randy L Diehl
Jun 24, 2005·IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics : a Publication of the IEEE Systems, Man, and Cybernetics Society·Georg SchneiderEdgar Körner
Aug 25, 2001·Annual Review of Neuroscience·E P Simoncelli, B A Olshausen
Aug 21, 2007·Annual Review of Psychology·Wilson S Geisler
Sep 9, 2005·Journal of Neurophysiology·Jonathan D VictorTatyana Sharpee
Jun 20, 2008·Journal of Neurophysiology·Ethan M MeyersTomaso Poggio
Sep 24, 2011·International Journal of Biomedical Imaging·Dan WangYunhe Shen
Mar 20, 2001·Neural Computation·M Zibulevsky, B A Pearlmutter
Mar 13, 2001·Neural Computation·A R Gardner-Medwin, H B Barlow
Jul 7, 2001·Neural Computation·A HyvärinenM Inki
Feb 20, 2003·Neural Computation·R A Choudrey, S J Roberts
Mar 7, 2003·Neural Computation·Jarmo Hurri, Aapo Hyvärinen
Jun 21, 2003·Neural Computation·Heiko Wersing, Edgar Körner
Feb 20, 2003·Neural Computation·Kenneth Kreutz-DelgadoTerrence J Sejnowski
Oct 13, 2004·Neural Computation·Muhua Li, James J Clark
May 8, 2004·Neural Computation·Yuanqing LiShun-ichi Amari
Nov 27, 2004·Neural Computation·David B Grimes, Rajesh P N Rao
Jun 23, 2005·Neural Computation·Bruno A Olshausen, David J Field
Dec 28, 2005·Neural Computation·Michael S FalconbridgeDavid R Badcock
Dec 28, 2005·Neural Computation·Simon OsinderoGeoffrey E Hinton

❮ Previous
Next ❯

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.