Input nonlinearities can shape beyond-pairwise correlations and improve information transmission by neural populations

Physical Review. E, Statistical, Nonlinear, and Soft Matter Physics
Joel Zylberberg, Eric Shea-Brown

Abstract

While recent recordings from neural populations show beyond-pairwise, or higher-order, correlations (HOC), we have little understanding of how HOC arise from network interactions and of how they impact encoded information. Here, we show that input nonlinearities imply HOC in spin-glass-type statistical models. We then discuss one such model with parametrized pairwise- and higher-order interactions, revealing conditions under which beyond-pairwise interactions increase the mutual information between a given stimulus type and the population responses. For jointly Gaussian stimuli, coding performance is improved by shaping output HOC only when neural firing rates are constrained to be low. For stimuli with skewed probability distributions (like natural image luminances), performance improves for all firing rates. Our work suggests surprising connections between nonlinear integration of neural inputs, stimulus statistics, and normative theories of population coding. Moreover, it suggests that the inclusion of beyond-pairwise interactions could improve the performance of Boltzmann machines for machine learning and signal processing applications.

References

Dec 1, 1979·Biological cybernetics·D R Brillinger, J P Segundo
Sep 1, 1993·Journal of Neurophysiology·B W Mel
Jan 13, 1998·Vision Research·D L Ruderman
Feb 3, 1998·Proceedings. Biological Sciences·R BaddeleyE T Rolls
Aug 8, 1994·Physical Review Letters·D L Ruderman, W Bialek
Aug 25, 2001·Annual Review of Neuroscience·E P Simoncelli, B A Olshausen
Feb 20, 2003·Neural Computation·Shun-Ichi AmariYutaka Sakai
Oct 1, 1961·The International Journal of Clinical and Experimental Hypnosis·B B RAGINSKY
Dec 20, 2003·Physical Review Letters·Elad SchneidmanWilliam Bialek
May 8, 2004·Neural Computation·Maoz Shamir, Haim Sompolinsky
May 25, 2004·Nature Neuroscience·Alon PolskyJackie Schiller
May 11, 2005·Journal of Neurobiology·Allan T GulledgeGreg J Stuart
Jul 22, 2005·Annual Review of Neuroscience·Michael London, Michael Häusser
Oct 11, 2005·Journal of the Optical Society of America. A, Optics, Image Science, and Vision·W H Hsiao, R P Millane
Jun 9, 2006·Nature Reviews. Neuroscience·Bruno B AverbeckAlexandre Pouget
Aug 11, 2006·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Jonathon ShlensE J Chichilnisky
Nov 24, 2006·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Michael R DeWeese, Anthony M Zador
Feb 1, 2008·PLoS Biology·Tomás HromádkaAnthony M Zador
Apr 17, 2009·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Jonathon ShlensE J Chichilnisky
Jul 22, 2009·Philosophical Transactions. Series A, Mathematical, Physical, and Engineering Sciences·Fernando MontaniStefano Panzeri
Jul 29, 2009·Neural Computation·Kresimir JosićJaime de la Rocha
Jul 6, 2010·Nature·Ifije E OhiorhenuanJonathan D Victor
Jul 28, 2010·Proceedings of the National Academy of Sciences of the United States of America·Gasper TkacikElad Schneidman
Jan 29, 2011·Nature Neuroscience·Ian H Stevenson, Konrad P Kording
May 24, 2011·Proceedings of the National Academy of Sciences of the United States of America·Elad GanmorElad Schneidman
Jun 24, 2011·PloS One·Gašper TkačikVijay Balasubramanian
Oct 7, 2011·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Alexander S EckerMatthias Bethge
Dec 2, 2011·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Shan YuDietmar Plenz
Oct 30, 2012·Nature·Mark T HarnettJeffrey C Magee
Jan 18, 2013·Journal of Biomolecular NMR·Michael P Latham, Lewis E Kay
Feb 2, 2013·Physical Review. E, Statistical, Nonlinear, and Soft Matter Physics·Joel ZylberbergMichael Robert Deweese
Feb 7, 2013·Physical Review Letters·Greg J StephensWilliam Bialek
Mar 22, 2013·PLoS Computational Biology·Einat Granot-AtedgiElad Schneidman
Mar 29, 2013·The Journal of Neuroscience : the Official Journal of the Society for Neuroscience·Paul D KingMichael R DeWeese
Sep 7, 2013·PLoS Computational Biology·Joel Zylberberg, Michael Robert DeWeese
Jan 7, 2014·PLoS Computational Biology·Gašper TkačikMichael J Berry
Feb 26, 2014·Frontiers in Computational Neuroscience·Andrea K BarreiroEric Shea-Brown
Jul 6, 2014·PLoS Computational Biology·Urs KösterBruno A Olshausen
Jun 5, 2015·Frontiers in Computational Neuroscience·Natasha A Cayco-GajicEric Shea-Brown
Aug 13, 2015·Journal of Mathematical Neuroscience·David A Leen, Eric Shea-Brown

❮ Previous
Next ❯

Citations

Aug 13, 2015·Journal of Mathematical Neuroscience·David A Leen, Eric Shea-Brown
Aug 20, 2016·PLoS Computational Biology·Brendan Chambers, Jason N MacLean
Apr 19, 2017·PLoS Computational Biology·Joel ZylberbergEric Shea-Brown
May 10, 2020·PLoS Computational Biology·Lisandro MontangieJulijana Gjorgjieva
Mar 17, 2017·Physical Review. E·Marie LevakovaPetr Lansky
Apr 18, 2021·Annual Review of Neuroscience·Rava Azeredo da Silveira, Fred Rieke

❮ Previous
Next ❯

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.

Related Papers

Frontiers in Computational Neuroscience
Natasha A Cayco-GajicEric Shea-Brown
Frontiers in Computational Neuroscience
Andrea K BarreiroEric Shea-Brown
The Journal of Neuroscience : the Official Journal of the Society for Neuroscience
Alejandro F BujanArvind Kumar
© 2022 Meta ULC. All rights reserved