SUN: A Bayesian framework for saliency using natural statistics.

Journal of Vision
Lingyun ZhangGarrison W Cottrell

Abstract

We propose a definition of saliency by considering what the visual system is trying to optimize when directing attention. The resulting model is a Bayesian framework from which bottom-up saliency emerges naturally as the self-information of visual features, and overall saliency (incorporating top-down information with bottom-up saliency) emerges as the pointwise mutual information between the features and the target when searching for a target. An implementation of our framework demonstrates that our model's bottom-up saliency maps perform as well as or better than existing algorithms in predicting people's fixations in free viewing. Unlike existing saliency measures, which depend on the statistics of the particular image being viewed, our measure of saliency is derived from natural image statistics, obtained in advance from a collection of natural images. For this reason, we call our model SUN (Saliency Using Natural statistics). A measure of saliency based on natural image statistics, rather than based on a single test image, provides a straightforward explanation for many search asymmetries observed in humans; the statistics of a single test image lead to predictions that are not consistent with these asymmetries. In our mod...Continue Reading

Citations

May 10, 2011·Nature Neuroscience·Wei Ji MaAlexandre Pouget
Jul 31, 2012·Visual Cognition·Michael DorrErhardt Barth
Mar 8, 2012·PLoS Computational Biology·Ruben Coen-CagliOdelia Schwartz
Jan 24, 2013·PLoS Computational Biology·Niklas WilmingPeter König
Sep 21, 2011·PloS One·Niklas WilmingPeter König
Jul 28, 2009·Attention, Perception & Psychophysics·Sonja EngmannWolfgang Einhäuser
Jul 10, 2012·Behavior Research Methods·Olivier Le Meur, Thierry Baccino
Feb 3, 2016·Cognitive Neurodynamics·Hassan Zanganeh Momtaz, Mohammad Reza Daliri
Jan 21, 2016·Computational Intelligence and Neuroscience·Zhiyong HeLining Sun
Jun 9, 2016·Cognitive Neurodynamics·Qi LvLiming Zhang
May 4, 2010·Current Opinion in Neurobiology·Wolfgang Einhäuser, Peter König
Apr 1, 2015·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Srenivas Varadarajan, Lina J Karam
Jan 22, 2015·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Satohiro Tajima, Kazuteru Komine
Jul 18, 2015·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Wenbin ZouNikos Komodakis
Jan 27, 2015·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Ming Liang, Xiaolin Hu
Aug 15, 2014·IEEE Transactions on Cybernetics·Ming Liang, Xiaolin Hu
May 9, 2015·Vision Research·Z BylinskiiJ K Tsotsos
Feb 11, 2015·Vision Research·Neil D B BruceJohn K Tsotsos
Sep 5, 2015·IEEE Transactions on Pattern Analysis and Machine Intelligence·Yan LuoQi Zhao
Apr 8, 2015·IEEE Transactions on Medical Imaging·Yixuan YuanMax Q-H Meng
Apr 9, 2014·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Zhi LiuOlivier Le Meur
Jun 12, 2014·IEEE Transactions on Cybernetics·Zhen LiangDavid D Feng
Jun 22, 2014·IEEE Transactions on Cybernetics·Guokang ZhuYuan Yuan
Jul 23, 2014·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Yuming FangZhijun Fang
Jul 17, 2014·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Xiaoshuai SunXian-Ming Liu
Sep 8, 2012·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Yulin XieMing-Hsuan Yang
Sep 10, 2015·IEEE Transactions on Pattern Analysis and Machine Intelligence·Emre Akbas, Narendra Ahuja
Oct 13, 2012·IEEE Transactions on Cybernetics·Qi WangXuelong Li
Aug 28, 2014·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Huawei TianZhenfeng Zhu
Sep 10, 2015·IEEE Transactions on Pattern Analysis and Machine Intelligence·Ming-Ming ChengShi-Min Hu
Jun 13, 2013·IEEE Transactions on Cybernetics·Guokang ZhuPingkun Yan
Feb 26, 2014·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Haksub KimAlan Conrad Bovik
Sep 21, 2013·IEEE Transactions on Pattern Analysis and Machine Intelligence·Naila MurrayC Alejandro Parraga
Apr 12, 2014·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Luming ZhangXuelong Li
May 1, 2010·IEEE Transactions on Pattern Analysis and Machine Intelligence·Marco Loog, François Lauze
Jul 18, 2012·IEEE Transactions on Pattern Analysis and Machine Intelligence·Jian LiHangen He
Apr 21, 2012·IEEE Transactions on Pattern Analysis and Machine Intelligence·Eleonora VigErhardt Barth
Mar 23, 2011·IEEE Transactions on Pattern Analysis and Machine Intelligence·Alexander Toet
Apr 11, 2012·IEEE Transactions on Pattern Analysis and Machine Intelligence·Ali Borji, Laurent Itti
May 18, 2011·IEEE Transactions on Pattern Analysis and Machine Intelligence·A Andreopoulos, John K Tsotsos
Jul 27, 2011·IEEE Transactions on Pattern Analysis and Machine Intelligence· Xiaodi HouChristof Koch
May 30, 2012·IEEE Transactions on Pattern Analysis and Machine Intelligence·Yuewei LinSong Wang

❮ Previous
Next ❯

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.