DOI: 10.1101/505032Dec 22, 2018Paper

Dynamic allocation of computational resources for deep learning-enabled cellular image analysis with Kubernetes

BioRxiv : the Preprint Server for Biology
Dylan BannonDavid Van Valen

Abstract

Deep learning is transforming the ability of life scientists to extract information from images. These techniques have better accuracy than conventional approaches and enable previously impossible analyses. As the capability of deep learning methods expands, they are increasingly being applied to large imaging datasets. The computational demands of deep learning present a significant barrier to large-scale image analysis. To meet this challenge, we have developed DeepCell 2.0, a platform for deploying deep learning models on large imaging datasets (>100,000 megapixel-scale images) in the cloud. This software enables the turnkey deployment of a Kubernetes cluster on all commonly used operating systems. By using a microservice architecture, our platform matches computational operations with their hardware requirements to reduce operating costs. Further, it scales computational resources to meet demand, drastically reducing the time necessary for analysis of large datasets. A thorough analysis of costs demonstrates that cloud computing is economically competitive for this application. By treating hardware infrastructure as software, this work foreshadows a new generation of software packages for biology in which computational reso...Continue Reading

Related Concepts

Diagnostic Imaging
Learning
Computer Software
Analysis
Enabling
Computed (Procedure)
[Pasteurella] aerogenes-[Pasteurella] mairii-[Actinobacillus] rossii complex
Environmental Infrastructure

Related Feeds

BioRxiv & MedRxiv Preprints

BioRxiv and MedRxiv are the preprint servers for biology and health sciences respectively, operated by Cold Spring Harbor Laboratory. Here are the latest preprint articles (which are not peer-reviewed) from BioRxiv and MedRxiv.

Related Papers

Conference Proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society
George V Koutelakis, Dimitrios K Lymperopoulos
BioRxiv : the Preprint Server for Biology
Payam Emami KhoonsariOla Spjuth
© 2021 Meta ULC. All rights reserved