Deep learning cardiac motion analysis for human survival prediction

Nature Machine Intelligence
Ghalib BelloDeclan P O'Regan

Abstract

Motion analysis is used in computer vision to understand the behaviour of moving objects in sequences of images. Optimising the interpretation of dynamic biological systems requires accurate and precise motion tracking as well as efficient representations of high-dimensional motion trajectories so that these can be used for prediction tasks. Here we use image sequences of the heart, acquired using cardiac magnetic resonance imaging, to create time-resolved three-dimensional segmentations using a fully convolutional network trained on anatomical shape priors. This dense motion model formed the input to a supervised denoising autoencoder (4Dsurvival), which is a hybrid network consisting of an autoencoder that learns a task-specific latent code representation trained on observed outcome data, yielding a latent representation optimised for survival prediction. To handle right-censored survival outcomes, our network used a Cox partial likelihood loss function. In a study of 302 patients the predictive accuracy (quantified by Harrell's C-index) was significantly higher (p = .0012) for our model C=0.75 (95% CI: 0.70 - 0.79) than the human benchmark of C=0.59 (95% CI: 0.53 - 0.65). This work demonstrates how a complex computer vision ...Continue Reading

References

Oct 1, 1987·The American Review of Respiratory Disease·J ZaagsmaV Veenstra
Jan 15, 1995·Statistics in Medicine·D Faraggi, R Simon
Oct 26, 1999·IEEE Transactions on Medical Imaging·D RueckertD J Hawkes
Sep 10, 2011·Bioinformatics·Markus S SchröderBenjamin Haibe-Kains
Nov 1, 2011·Bioinformatics·Daniel J Stekhoven, Peter Bühlmann
Apr 27, 2013·Journal of Digital Imaging·Mark WoodbridgeDeclan P O'Regan
May 3, 2013·Journal of Cardiovascular Magnetic Resonance : Official Journal of the Society for Cardiovascular Magnetic Resonance·Jeanette Schulz-MengerEike Nagel
Jun 8, 2013·Medical Image Analysis·Wenzhe ShiDaniel Rueckert
Oct 10, 2013·Journal of Cardiovascular Magnetic Resonance : Official Journal of the Society for Cardiovascular Magnetic Resonance·Christopher M KramerUNKNOWN Society for Cardiovascular Magnetic Resonance Board of Trustees Task Force on Standardized Protocols
Jun 27, 2014·American Journal of Epidemiology·Gordon C S SmithIan R White
Nov 2, 2014·PloS One·Xingyu ZhangPau Medrano-Gracia
Dec 3, 2014·Journal of the American College of Cardiology·Tariq AhmadG Michael Felker
Jun 13, 2015·Circulation. Cardiovascular Imaging·Julia GrapsaPetros Nihoyannopoulos
Oct 17, 2016·Journal of Biomedical Informatics·Brett K Beaulieu-JonesUNKNOWN Pooled Resource Open-Access ALS Clinical Trials Consortium
Dec 13, 2016·Computational and Structural Biotechnology Journal·Evanthia E TripolitiDimitrios I Fotiadis
Mar 17, 2017·European Respiratory Review : an Official Journal of the European Respiratory Society·Deepa GopalanMatthias Held
Mar 17, 2017·Annual Review of Biomedical Engineering·Dinggang ShenHeung-Il Suk
Mar 18, 2017·The Journal of Heart and Lung Transplantation : the Official Publication of the International Society for Heart Transplantation·Henning GallHossein A Ghofrani
Jun 18, 2017·Heart Failure Reviews·A ScatteiaC Bucciarelli-Ducci
Jun 25, 2017·Medical Image Analysis·Esther Puyol-AntónAndrew P King
Aug 5, 2017·Medical Image Analysis·Geert LitjensClara I Sánchez
Aug 9, 2017·Cardiac Failure Review·Gianluigi Savarese, Lars H Lund
Aug 11, 2017·Circulation Research·Bharath Ambale-VenkateshJoão A C Lima
Dec 2, 2017·Current Opinion in Cardiology·Saqib Ejaz AwanGirish Dwivedi
Feb 28, 2018·BMC Medical Research Methodology·Jared L KatzmanYuval Kluger
Apr 6, 2018·Journal of the Royal Society, Interface·Travers ChingCasey S Greene
Apr 11, 2018·PLoS Computational Biology·Travers ChingLana X Garmire
Jun 26, 2017·JACC. Basic to Translational Science·Kipp W JohnsonJoel T Dudley
Sep 1, 2018·European Heart Journal Cardiovascular Imaging·Hugo G HulshofDick H J Thijssen
Sep 16, 2018·Journal of Cardiovascular Magnetic Resonance : Official Journal of the Society for Cardiovascular Magnetic Resonance·Wenjia BaiDaniel Rueckert

❮ Previous
Next ❯

Citations

Feb 6, 2019·Endocrine Practice : Official Journal of the American College of Endocrinology and the American Association of Clinical Endocrinologists·Sara AhmadiJulie A Sosa
Jul 8, 2019·European Heart Journal Cardiovascular Imaging·Anish N BhuvaCharlotte H Manisty
Nov 2, 2019·AJR. American Journal of Roentgenology·Qian TaoRob J van der Geest
Dec 6, 2019·Briefings in Bioinformatics·Bohdan B KhomtchoukThemistocles L Assimes
Jan 25, 2020·Heart·Antonio de MarvaoDeclan P O'Regan
Oct 9, 2019·Journal of Cardiovascular Magnetic Resonance : Official Journal of the Society for Cardiovascular Magnetic Resonance·Tim LeinerAlistair A Young
Jun 9, 2020·Expert Review of Medical Devices·Andrew LinDamini Dey
Dec 5, 2019·NPJ Digital Medicine·Mohammed UddinMarc Woodbury-Smith
Feb 11, 2020·Frontiers in Bioengineering and Biotechnology·Yasunari Matsuzaka, Yoshihiro Uesawa
Mar 21, 2020·Frontiers in Cardiovascular Medicine·Chen ChenDaniel Rueckert
Feb 23, 2020·Radiology. Artificial Intelligence·Julius Chapiro, James S Duncan
Jul 7, 2020·Circulation. Arrhythmia and Electrophysiology·Albert K FeenyPaul J Wang
Jan 31, 2020·Frontiers in Cardiovascular Medicine·Nicolas DuchateauMathieu De Craene
Feb 6, 2020·BMC Medical Informatics and Decision Making·Davide Chicco, Giuseppe Jurman
Jul 23, 2020·Frontiers in Cardiovascular Medicine·Kathleen GilbertAvan Suinesiaputra
Jan 30, 2020·NPJ Digital Medicine·Amirata GhorbaniJames Y Zou
Sep 11, 2020·Current Cardiology Reports·Manoj MannilBettina Baessler
Feb 11, 2020·Frontiers in Cardiovascular Medicine·Antonio de MarvaoDeclan P O'Regan
Jan 20, 2021·International Journal of Computer Assisted Radiology and Surgery·Xue FuDongsheng Li
Jan 30, 2021·American Journal of Physiology. Heart and Circulatory Physiology·Ana María Sánchez de la NavaFrancisco Fernández-Avilés
Dec 12, 2020·Scientific Reports·Jörg SanderIvana Išgum
Dec 11, 2020·Journal of Translational Medicine·Murugan SubramanianLotfi Chouchane
Jan 10, 2021·Computers in Biology and Medicine·Karen Andrea Lara HernandezChristian Baumgartner
Mar 27, 2020·Physics in Medicine and Biology·Yajun LiChanghong Liang
Jan 24, 2021·NPJ Digital Medicine·Amirata GhorbaniJames Y Zou
Mar 14, 2021·Nature Reviews. Cardiology·Maxime SermesantNicholas Ayache
Jun 7, 2020·Journal of Clinical Anesthesia·Ying WangJian-Jun Yang
Oct 27, 2020·Neurocomputing·M AlamK M Iftekharuddin
Mar 23, 2021·Patterns·Andreas Kopf, Manfred Claassen
Jun 17, 2020·Radiotherapy and Oncology : Journal of the European Society for Therapeutic Radiology and Oncology·Liwen ZhangJie Tian
May 19, 2021·Magnetic Resonance in Medicine : Official Journal of the Society of Magnetic Resonance in Medicine·Markus Johannes AnkenbrandLaura Maria Schreiber
Aug 3, 2021·Journal of Healthcare Engineering·Fuguang JiZhangshuan Bi
Aug 17, 2021·Frontiers in Neuroscience·Mandong HuZhihan Lv
Aug 31, 2021·Journal of Imaging·Sulaiman VesalNishant Ravikumar

❮ Previous
Next ❯

Software Mentioned

missForest
Optunity
4Dsurvival
Keras
TensorFlow
R package survcomp
PSO
cmr42
Circle Cardiovascular Imaging

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.

Related Papers

Conference Proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society
S SabbaghiR Garnavi
IEEE Transactions on Pattern Analysis and Machine Intelligence
Vittal PremachandranDhruv Batra
Conference Proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society
Shuo WangJie Tian
© 2022 Meta ULC. All rights reserved