Convolutional networks can learn to generate affinity graphs for image segmentation

Neural Computation
Srinivas C TuragaH Sebastian Seung

Abstract

Many image segmentation algorithms first generate an affinity graph and then partition it. We present a machine learning approach to computing an affinity graph using a convolutional network (CN) trained using ground truth provided by human experts. The CN affinity graph can be paired with any standard partitioning algorithm and improves segmentation accuracy significantly compared to standard hand-designed affinity functions. We apply our algorithm to the challenging 3D segmentation problem of reconstructing neuronal processes from volumetric electron microscopy (EM) and show that we are able to learn a good affinity graph directly from the raw EM images. Further, we show that our affinity graph improves the segmentation accuracy of both simple and sophisticated graph partitioning algorithms. In contrast to previous work, we do not rely on prior knowledge in the form of hand-designed image features or image preprocessing. Thus, we expect our algorithm to generalize effectively to arbitrary image types.

References

Jul 22, 1999·The British Journal of Ophthalmology·C SinthanayothinT H Williamson
Jun 22, 2002·IEEE Transactions on Information Technology in Biomedicine : a Publication of the IEEE Engineering in Medicine and Biology Society·Khalid A Al-KofahiBadrinath Roysam
Sep 24, 2004·IEEE Transactions on Pattern Analysis and Machine Intelligence·Pascal MatsakisJonathon Marjamaa
Apr 9, 2005·Journal of Microscopy·J C Fiala
Sep 30, 2005·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Feng NingPaolo Emilio Barbano
Nov 29, 2005·Medical Image Analysis·Jianming LiangDemetri Terzopoulos
Sep 12, 2006·Current Opinion in Neurobiology·Kevin L Briggman, Winfried Denk
Oct 24, 2007·IEEE Transactions on Medical Imaging·Elisa Ricci, Renzo Perfetti
Dec 18, 2007·Current Opinion in Neurobiology·Stephen J Smith
Jan 1, 1995·IEEE Transactions on Neural Networks·R Nekovei, Y Sun
Jul 12, 2008·Medical Image Analysis·Elizabeth JurrusRoss Whitaker
Nov 12, 1986·Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences·J G WhiteS Brenner

❮ Previous
Next ❯

Citations

Feb 23, 2011·Neuroinformatics·Ju Lu
Mar 11, 2011·Nature·Davi D BockR Clay Reid
May 9, 2014·Nature·Jinseop S KimUNKNOWN EyeWirers
Apr 3, 2014·Journal of Computational Neuroscience·Venkatakrishnan Ramaswamy, Arunava Banerjee
Aug 31, 2010·Current Opinion in Neurobiology·Viren JainSrinivas C Turaga
Sep 14, 2010·Current Opinion in Neurobiology·Dmitri B ChklovskiiLouis K Scheffer
Jul 27, 2015·Medical Image Analysis·Mustafa Gokhan UzunbasDimitris Metaxas
Jan 22, 2011·Annals of the New York Academy of Sciences·Olaf Sporns
Apr 18, 2012·Journal of Microscopy·E U MumcuogluM N Gurcan
May 13, 2015·IEEE Transactions on Bio-medical Engineering·Youyi SongTianfu Wang
Jun 22, 2013·IEEE Transactions on Pattern Analysis and Machine Intelligence·Yoshua BengioPascal Vincent
Jun 19, 2013·IEEE Transactions on Medical Imaging·Carlos BeckerPascal Fua
Mar 7, 2012·IEEE Transactions on Pattern Analysis and Machine Intelligence·Shuiwang JiKai Yu
Sep 20, 2011·IEEE Transactions on Bio-medical Engineering·Sylvain JaumeR Clay Reid
Oct 15, 2011·IEEE Transactions on Medical Imaging·Aurélien LucchiPascal Fua
Sep 25, 2015·Neuron·Manuel BerningMoritz Helmstaedter
Dec 3, 2014·Neural Networks : the Official Journal of the International Neural Network Society·Jürgen Schmidhuber
May 29, 2015·Nature·Yann LeCunGeoffrey Hinton
May 6, 2014·Micron : the International Research and Review Journal for Microscopy·Christopher J Peddie, Lucy M Collinson
Mar 21, 2015·Medical Image Analysis·Verena KaynigHanspeter Pfister
Mar 1, 2012·Medical Image Analysis·Bjoern AndresFred A Hamprecht
Oct 14, 2014·Frontiers in Neural Circuits·William M DeBelloDouglas J Totten
Oct 7, 2015·IEEE Transactions on Medical Imaging·Holger RothRonald Summers
Feb 26, 2016·IEEE Transactions on Medical Imaging·Michiel KallenbergMartin Lillholm
Feb 18, 2016·IEEE Transactions on Medical Imaging· Qi Dou Pheng-Ann Heng
Sep 16, 2016·BMC Bioinformatics·Shenghua ChengShaoqun Zeng
Sep 24, 2016·Cell·Xun Helen HouBernardo Luis Sabatini
Aug 27, 2013·PloS One·Juan Nunez-IglesiasDmitri B Chklovskii
Jan 24, 2017·IEEE Transactions on Medical Imaging·Ahmed FakhryShuiwang Ji
Mar 3, 2017·Nature Methods·Sven DorkenwaldJoergen Kornfeld
Jun 10, 2017·Neural Computation·Waseem Rawat, Zenghui Wang
Mar 14, 2017·IEEE Transactions on Medical Imaging·Rongjian LiShuiwang Ji
Nov 29, 2017·Nature Genetics·Sevin TurcanTimothy A Chan
Mar 2, 2018·Abdominal Radiology·Laura J BrattainAnthony E Samir
Aug 9, 2013·Nature·Moritz HelmstaedterWinfried Denk
Jul 12, 2011·Nature Neuroscience·Moritz HelmstaedterWinfried Denk

❮ Previous
Next ❯

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.