Brain tumor segmentation with Deep Neural Networks

Medical Image Analysis
Mohammad HavaeiHugo Larochelle

Abstract

In this paper, we present a fully automatic brain tumor segmentation method based on Deep Neural Networks (DNNs). The proposed networks are tailored to glioblastomas (both low and high grade) pictured in MR images. By their very nature, these tumors can appear anywhere in the brain and have almost any kind of shape, size, and contrast. These reasons motivate our exploration of a machine learning solution that exploits a flexible, high capacity DNN while being extremely efficient. Here, we give a description of different model choices that we've found to be necessary for obtaining competitive performance. We explore in particular different architectures based on Convolutional Neural Networks (CNN), i.e. DNNs specifically adapted to image data. We present a novel CNN architecture which differs from those traditionally used in computer vision. Our CNN exploits both local features as well as more global contextual features simultaneously. Also, different from most traditional uses of CNNs, our networks use a final layer that is a convolutional implementation of a fully connected layer which allows a 40 fold speed up. We also describe a 2-phase training procedure that allows us to tackle difficulties related to the imbalance of tumo...Continue Reading

References

Aug 4, 1998·IEEE Transactions on Medical Imaging·M C ClarkM S Silbiger
Sep 29, 2004·Medical Image Analysis·Marcel PrastawaGuido Gerig
Aug 13, 2011·International Journal of Computer Assisted Radiology and Surgery·Karteek PopuriMartin Jägersand
Dec 31, 2011·IEEE Transactions on Medical Imaging·Andac HamamciGozde Unal
Jun 8, 2013·Physics in Medicine and Biology·Stefan BauerMauricio Reyes
Jun 22, 2013·IEEE Transactions on Pattern Analysis and Machine Intelligence·Yoshua BengioPascal Vincent
Jun 22, 2013·IEEE Transactions on Pattern Analysis and Machine Intelligence·Clément FarabetYann Lecun
Sep 24, 2013·IEEE Transactions on Medical Imaging·Paulo MendoncaDushyant Sahani
May 8, 2014·Journal of Anaesthesiology, Clinical Pharmacology·Uma HariharanDhirja Sharma
Dec 11, 2014·IEEE Transactions on Medical Imaging·Bjoern MenzeKoen Van Leemput

Citations

Apr 24, 2016·Medical & Biological Engineering & Computing·Eugene VorontsovSamuel Kadoury
Mar 28, 2017·International Journal of Computer Assisted Radiology and Surgery·M Hossein JafariKayvan Najarian
Jan 23, 2018·Microscopy Research and Technique·Sajid IqbalAmjad Rehman
Dec 22, 2017·Radiology·Ki Hwan KimSung-Hong Park
Oct 19, 2017·Computer Assisted Surgery·Xiaoqing Zhang
Dec 22, 2017·Physics in Medicine and Biology·Shenhai ZhengYi Wang
Nov 15, 2017·Acta neurochirurgica·Joeky T SendersOmar Arnaout
Jul 6, 2017·IEEE Transactions on Medical Imaging·Seyed Sadegh Mohseni SalehiAli Gholipour
May 18, 2018·IEEE Transactions on Neural Networks and Learning Systems·Mufti MahmudStefano Vassanelli
Mar 1, 2018·Journal of Digital Imaging·Farnaz HoseiniPeyman Bayat
Jul 12, 2018·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Zhiming LuoPierre-Marc Jodoin
Jul 12, 2018·IEEE Transactions on Medical Imaging·Frederic CommandeurDamini Dey
Jul 25, 2017·Medical Physics·Ying ZhugeRobert W Miller
Sep 29, 2018·Reviews in the Neurosciences·Golrokh Mirzaei, Hojjat Adeli
Oct 18, 2018·AJR. American Journal of Roentgenology·Eyal LotanYvonne W Lui
Dec 30, 2017·Journal of Medical Imaging·Varghese AlexGanapathy Krishnamurthi
Oct 28, 2018·Medical Physics·Berkman SahinerMaryellen L Giger
Jan 21, 2018·Food and Environmental Virology·Eisuke ItoTsuyoshi Kato
Mar 22, 2019·Journal of Magnetic Resonance Imaging : JMRI·Tommaso BanzatoAlessandro Zotti
May 31, 2018·Biomedizinische Technik. Biomedical Engineering·Behrouz Alizadeh SavarehMahyar Ghafoori
Mar 1, 2019·Physics in Medicine and Biology·Liyuan ChenJing Wang
Apr 15, 2018·Australasian Physical & Engineering Sciences in Medicine·B N AnoopPraveer Sihota
May 9, 2019·PloS One·Clifford Seth ParkerWilliam Brent Seales
Jun 10, 2019·Journal of Medical Systems·Jiawei SunBoqiang Liu
Apr 30, 2019·Microscopy Research and Technique·Sajid IqbalRashid Abbasi
Aug 3, 2019·Magnetic Resonance in Medicine : Official Journal of the Society of Magnetic Resonance in Medicine·Qianqian ZhangYanqiu Feng
Sep 25, 2019·Brain Sciences·Omneya AttallahHeba Gadelkarim
Aug 31, 2019·European Radiology·P A Gondim TeixeiraA Blum
Sep 5, 2019·International Journal of Computer Assisted Radiology and Surgery·Minh Nguyen Nhat ToJin Tae Kwak
Oct 24, 2019·Journal of Medical Systems·Javeria AminSteven Lawrence Fernandes
Aug 22, 2019·Current Pharmaceutical Biotechnology·Deeksha SaxenaRajnish Kumar
Aug 25, 2019·BMC Medical Imaging·Ya-Ping WuMei-Yun Wang
Dec 19, 2019·Journal of Medical Systems·Javaria AminSyed Ahmad Chan Bukhari
Jan 29, 2020·Current Medical Imaging Reviews·Ahmet Saygili, Songül Albayrak
Dec 10, 2019·Human Brain Mapping·Xiaoxiao WangBensheng Qiu
Mar 20, 2020·Journal of Magnetic Resonance Imaging : JMRI·Fabrício Guimarães GonçalvesSuyash Mohan
Jul 5, 2019·Korean Journal of Radiology : Official Journal of the Korean Radiological Society·Ji Eun ParkHo Sung Kim
Oct 18, 2019·Pediatric Radiology·Heike Daldrup-Link
May 7, 2020·Journal of Neurophysiology·Akshay MarkandayPeter Thier
Aug 20, 2019·Medical Physics·Samuel Botter MartinsClarissa Lin Yasuda
Nov 27, 2019·Aging·Alex ZhavoronkovPolina Mamoshina
Sep 15, 2020·Physical and Engineering Sciences in Medicine·Ahmad ShalbafArash Maghsoudi
Sep 23, 2020·Medical & Biological Engineering & Computing·Ejaz Ul HaqTijiang Zhan
Mar 14, 2018·Proceedings of the National Academy of Sciences of the United States of America·Pooya MobadersanyLee A D Cooper
May 15, 2018·Journal of Healthcare Engineering·Shaoguo CuiShuyu Xiong
Mar 29, 2018·International Journal of Computer Assisted Radiology and Surgery·Qi ZengSeptimiu E Salcudean
Jul 25, 2018·Journal of Digital Imaging·Farnaz HoseiniPeyman Bayat
Aug 21, 2018·Journal of Healthcare Engineering·Hiroyuki Sugimori
Oct 10, 2018·Journal of Medical Systems·Syed Muhammad AnwarMuhammad Khurram Khan
Apr 4, 2019·International Journal of Biomedical Imaging·Abdelmajid BousselhamAbdelhadi Raihani
Jul 30, 2019·Computational Intelligence and Neuroscience·Ting GeShanxiang Mu
Aug 29, 2019·Frontiers in Computational Neuroscience·Guotai WangTom Vercauteren
Oct 18, 2019·Frontiers in Neuroscience·Zeina A ShboulKhan M Iftekharuddin
Aug 14, 2019·Magnetic Resonance in Medicine : Official Journal of the Society of Magnetic Resonance in Medicine·Harikrishna RallapalliDaniel H Turnbull
Nov 20, 2019·Journal of Clinical Medicine·Dat Tien NguyenKang Ryoung Park
Dec 17, 2019·Journal of X-ray Science and Technology·Tiejun YangQi Tang
Mar 6, 2020·Frontiers in Computational Neuroscience·Ujjwal BaidAbhishek Mahajan
Dec 20, 2019·International Ophthalmology Clinics·Grayson W Armstrong, Alice C Lorch
Feb 27, 2020·Brain Sciences·Muhammad Waqas NadeemSuhail Ashfaq Butt
Feb 11, 2020·Frontiers in Computational Neuroscience·Subhashis Banerjee, Sushmita Mitra
Mar 31, 2020·European Journal of Nuclear Medicine and Molecular Imaging·Shuchao PangGuanfeng Liu
Jun 26, 2020·Medical & Biological Engineering & Computing·Insha Majeed Wani, Sakshi Arora
Jul 30, 2020·Journal of Healthcare Engineering·Wenjing WangZhongyuanlong Chen
Aug 15, 2020·Scientific Reports·Félix RenardNicolas Vuillerme
Sep 23, 2020·Scientific Reports·Ahmed T SahlolMohamed Abd Elaziz
Jun 4, 2017·Journal of Digital Imaging·Zeynettin AkkusB Erickson
May 17, 2018·International Journal of Computer Assisted Radiology and Surgery·Davood KarimiSeptimiu E Salcudean
Aug 2, 2018·Journal of Digital Imaging·Hongjun YoonDae Kyung Sohn
Nov 15, 2018·Journal of Healthcare Engineering·Aymen BougachaAhmed Ben Hamida
Jul 17, 2018·Computational and Mathematical Methods in Medicine·Joeky T SendersOmar Arnaout
Jan 4, 2019·Journal of Medical Systems·Aparna Natarajan, Sathiyasekar Kumarasamy
Oct 16, 2018·Biomedical Optics Express·Atefeh AbdolmanafiFarida Cheriet
Apr 5, 2019·Journal of Medical Imaging·Md Zahangir AlomVijayan K Asari
Dec 5, 2019·Scientific Reports·Rami R HallacAlex A Kane
Jan 31, 2020·Korean Journal of Radiology : Official Journal of the Korean Radiological Society·Geewon LeeHo Yun Lee
Sep 3, 2019·Frontiers in Oncology·Houman SotoudehGregory K Friedman
Feb 5, 2020·Current Medical Imaging Reviews·Muthalakshmi Murugesan, Dhanasekaran Ragavan
Apr 24, 2020·Frontiers in Computational Neuroscience·Xue FengCraig H Meyer
Jun 10, 2020·Insights Into Imaging·Abhishta BhandariMarc Agzarian
Feb 5, 2020·Frontiers in Neuroscience·Zeinab SherkatghanadVahid Salari
Jul 19, 2020·Medical & Biological Engineering & Computing·Ehab EssaM Z Rashad
Apr 14, 2020·Radiology. Artificial Intelligence·Shaocheng WuYuanfang Guan
May 7, 2020·International Journal of Computer Assisted Radiology and Surgery·Ramy A ZeineldinOliver Burgert
May 27, 2020·Computational and Mathematical Methods in Medicine·Min XuRaymond F Muzic
Sep 19, 2020·Journal of Personalized Medicine·Nguyen Quoc Khanh LeCheng-Yu Chen
Jun 12, 2020·Frontiers in Neuroinformatics·Yunyun DuanYongjun Wang
Jun 23, 2020·Medical & Biological Engineering & Computing·Giovanni L F da SilvaElton A A de Cavalcanti
Aug 1, 2020·Computational and Mathematical Methods in Medicine·Wentao WuHong Yan
Mar 17, 2017·Annual Review of Biomedical Engineering·Dinggang ShenHeung-Il Suk
Nov 9, 2017·Contrast Media & Molecular Imaging·Yong XueHanwei Chen
Jul 24, 2018·Journal of Healthcare Engineering·Jia QuHidenori Sakanashi
Apr 18, 2018·Nuclear Medicine and Molecular Imaging·Hongyoon Choi
Dec 1, 2018·Japanese Journal of Radiology·Koji Sakai, Kei Yamada
Apr 27, 2019·Frontiers in Neuroscience·Chuanlu LinDong Ni
Aug 14, 2019·Magnetic Resonance in Medicine : Official Journal of the Society of Magnetic Resonance in Medicine·Kinam KwonHyunWook Park
Apr 9, 2020·Frontiers in Neuroinformatics·Jia YouGilberto K K Leung
Nov 19, 2019·Frontiers in Plant Science·Jialin YuNathan S Boyd
Aug 3, 2020·Cancer Imaging : the Official Publication of the International Cancer Imaging Society·Xianling DongLijun Lu
Sep 8, 2020·Bio-medical Materials and Engineering·Yujie Yang, Qianqian Zhang
Oct 13, 2017·Physics in Medicine and Biology·Joshua J TimmonsEric T Wong
Oct 27, 2017·Journal of Healthcare Engineering·Ya-Ping WuMei-Yun Wang
Mar 7, 2019·Journal of Healthcare Engineering·Zhenglun KongShengpu Xu
Jul 28, 2019·International Journal of Computer Assisted Radiology and Surgery·Trevor J HuffJustin A Cramer
Mar 7, 2019·Journal of Healthcare Engineering·Mumtaz Hussain SoomroAndrea Laghi
Jul 28, 2019·Journal of Medical Internet Research·Syed Jamal Safdar GardeziTianfu Wang
Apr 10, 2019·Australasian Physical & Engineering Sciences in Medicine·Yalda AmirmoezziAmin Torabi Jahromi
Jan 25, 2019·Computational and Mathematical Methods in Medicine·Hong ZhuWei Wang
Jul 30, 2019·Frontiers in Computational Neuroscience·Daniel E CahallHassan M Fathallah-Shaykh
Jun 12, 2020·Korean Journal of Radiology : Official Journal of the Korean Radiological Society·Seung Hak LeeEun Sook Ko
Feb 13, 2020·BMC Medical Imaging·Xiaojun HuMauricio Reyes
Jul 11, 2020·BMC Medical Informatics and Decision Making·Xibin JiaDawei Yang
Jan 24, 2019·Cancers·Gopal S TandelJasjit S Suri
Dec 23, 2018·Journal of Magnetic Resonance Imaging : JMRI·Maciej A MazurowskiMustafa R Bashir
Apr 15, 2020·Proceedings of the National Academy of Sciences of the United States of America·Yoav N NygateNatan T Shaked
Oct 30, 2020·Frontiers in Neuroscience·Li-Ming HsuYen-Yu Ian Shih
Jul 30, 2020·Current Medical Imaging·Jianxin ZhangBin Liu
Dec 15, 2020·Briefings in Bioinformatics·Ninon BurgosOlivier Colliot
Dec 18, 2020·International Journal of Legal Medicine·Markus Auf der MauerDennis Säring
Dec 20, 2020·Journal of Applied Clinical Medical Physics·Jesang YuEun Kyung Choi
Jan 9, 2021·PloS One·Mohamed Abd ElazizAhmed A Ewees
Nov 25, 2020·Computerized Medical Imaging and Graphics : the Official Journal of the Computerized Medical Imaging Society·Tongxue ZhouSu Ruan
Dec 29, 2020·Magnetic Resonance Imaging·Hiroyuki SugimoriKinya Ishizaka
Nov 2, 2020·Computer Methods and Programs in Biomedicine·Asieh KhosravanianSaeed Mozaffari
Jan 10, 2020·NeuroImage. Clinical·Mostafa SalemXavier Lladó
Oct 21, 2020·Medical Image Analysis·Hoel KervadecIsmail Ben Ayed
Jun 12, 2020·NeuroImage·Leonie HenschelMartin Reuter
Nov 14, 2017·Emerging Topics in Life Sciences·William JonesLeopold Parts
Nov 17, 2020·Computational and Mathematical Methods in Medicine·Saleem Z Ramadan
Nov 2, 2018·Frontiers in Robotics and AI·Martin CenekSpencer Dahl
Feb 12, 2021·Computerized Medical Imaging and Graphics : the Official Journal of the Computerized Medical Imaging Society·Bjoern MenzeSpyridon Bakas
Jan 12, 2021·Evolutionary Intelligence·D R Sarvamangala, Raghavendra V Kulkarni
Jan 20, 2021·Artificial Intelligence in Medicine·Jian ZhangDinggang Shen
Feb 2, 2021·The International Journal of Neuroscience·Mohsen AhmadiNastaran Soleimani
Jan 16, 2021·International Journal of Chronic Obstructive Pulmonary Disease·Joyce D SchroederTolga Tasdizen
Jun 19, 2018·Frontiers in Robotics and AI·Tomohiro FukudaAkihito Sano
Jan 14, 2021·Neural Computing & Applications·Rajeev Kumar SinghRishie Nandhan Babu
Feb 17, 2021·BMC Medical Imaging·Markus J AnkenbrandLaura M Schreiber
Dec 29, 2020·Computers in Biology and Medicine·Suichang ZhengFucang Jia
Mar 24, 2020·Computer Methods and Programs in Biomedicine·Minyoung ChungYeong-Gil Shin
Nov 23, 2020·Computer Methods and Programs in Biomedicine·Palash GhosalDebashis Nandi
Dec 15, 2020·Computer Methods and Programs in Biomedicine·Jun ChenYue Duan

Related Concepts

Machine Learning
Brain Tumor, Recurrent
Glioblastoma Multiforme
Optical Image Reconstruction
Magnetization Transfer Contrast Imaging
Neural Network Simulation
Brain
Brain Neoplasms
Glioblastoma
Magnetic Resonance Imaging

Related Feeds

CSF & Lymphatic System

This feed focuses on Cerebral Spinal Fluid (CSF) and the lymphatic system. Discover the latest papers using imaging techniques to track CSF outflow into the lymphatic system in animal models.

Related Papers

Computational and Mathematical Methods in Medicine
Liya Zhao, Kebin Jia
IEEE Transactions on Pattern Analysis and Machine Intelligence
Fayao LiuIan Reid
Neural Networks : the Official Journal of the International Neural Network Society
Tara N SainathBhuvana Ramabhadran
Computational Intelligence and Neuroscience
Srdjan SladojevicDarko Stefanovic
© 2021 Meta ULC. All rights reserved