Lessons from the DREAM2 Challenges

Annals of the New York Academy of Sciences
Gustavo StolovitzkyAndrea Califano

Abstract

Regardless of how creative, innovative, and elegant our computational methods, the ultimate proof of an algorithm's worth is the experimentally validated quality of its predictions. Unfortunately, this truism is hard to reduce to practice. Usually, modelers produce hundreds to hundreds of thousands of predictions, most (if not all) of which go untested. In a best-case scenario, a small subsample of predictions (three to ten usually) is experimentally validated, as a quality control step to attest to the global soundness of the full set of predictions. However, whether this small set is even representative of the global algorithm's performance is a question usually left unaddressed. Thus, a clear understanding of the strengths and weaknesses of an algorithm most often remains elusive, especially to the experimental biologists who must decide which tool to use to address a specific problem. In this chapter, we describe the first systematic set of challenges posed to the systems biology community in the framework of the DREAM (Dialogue for Reverse Engineering Assessments and Methods) project. These tests, which came to be known as the DREAM2 challenges, consist of data generously donated by participants to the DREAM project and cu...Continue Reading

References

Oct 10, 2003·Bioinformatics·Pedro MendesKeying Ye
Mar 22, 2005·Nature Genetics·Katia BassoAndrea Califano
Jan 24, 2006·Nature·Anne-Claude GavinGiulio Superti-Furga
Mar 10, 2006·Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences·John Moult
Mar 16, 2007·Proceedings of the National Academy of Sciences of the United States of America·Jose M PoloAri Melnick
Oct 11, 2007·Annals of the New York Academy of Sciences·Gustavo StolovitzkyAndrea Califano
Jan 2, 2009·Proceedings of the National Academy of Sciences of the United States of America·Adam A MargolinGustavo Stolovitzky
Apr 8, 2009·Annals of the New York Academy of Sciences·Vinsensius B VegaNeil D Clarke
Apr 8, 2009·Annals of the New York Academy of Sciences·Daniel MarbachDario Floreano
Apr 8, 2009·Annals of the New York Academy of Sciences·Mario LauriaDiego di Bernardo
Apr 8, 2009·Annals of the New York Academy of Sciences·Mika GustafssonJesper Tegnér
Apr 8, 2009·Annals of the New York Academy of Sciences·Tejaswi GowdaSeungchan Kim
Apr 8, 2009·Annals of the New York Academy of Sciences·John WatkinsonDimitris Anastassiou

Citations

Jan 29, 2013·Nature Biotechnology·Matthew T WeirauchTimothy R Hughes
Jul 17, 2012·Nature Methods·Daniel MarbachGustavo Stolovitzky
Feb 12, 2013·Nature Methods·Nima AghaeepourRichard H Scheuermann
Sep 2, 2010·Nature Reviews. Microbiology·Riet De Smet, Kathleen Marchal
Mar 24, 2010·Proceedings of the National Academy of Sciences of the United States of America·Daniel MarbachGustavo Stolovitzky
Jul 8, 2010·Bioinformatics·Steffen KlamtK Sundmacher
Jul 9, 2011·Bioinformatics·Andrea PinnaAlberto de la Fuente
May 3, 2013·Genome Research·Brian C HaynesMichael R Brent
Sep 9, 2011·Science Signaling·Robert J PrillGustavo Stolovitzky
Apr 19, 2013·Science Translational Medicine·Adam A MargolinAnne-Lise Børresen-Dale
Aug 26, 2009·BMC Bioinformatics·Michael HeckerReinhard Guthke
Jan 29, 2010·BMC Bioinformatics·Alina SîrbuMartin Crane
Feb 26, 2014·BMC Bioinformatics·Piyush B MadhamshettiwarMark A Ragan
Jan 11, 2013·BMC Genomics·Alexander StatnikovConstantin F Aliferis
Oct 25, 2011·Theoretical Biology & Medical Modelling·Fadhl M AlakwaaYasser M Kadah
Feb 27, 2010·PloS One·Robert J PrillGustavo Stolovitzky
Oct 12, 2010·PloS One·Vân Anh Huynh-ThuPierre Geurts
Aug 23, 2012·PloS One·Marit AckermannAndreas Beyer
Sep 12, 2013·PloS One·Tapio ManninenMatti Nykter
Mar 8, 2014·PloS One·Caroline Siegenthaler, Rudiyanto Gunawan
Mar 29, 2014·BMC Systems Biology·Paola Vera-LiconaReinhard Laubenbacher
Apr 7, 2015·Journal of Computational Biology : a Journal of Computational Molecular Cell Biology·Anagha JoshiTom Michoel
May 24, 2013·Briefings in Bioinformatics·Stefan R MaetschkeMark A Ragan
May 12, 2012·Journal of Biomedicine & Biotechnology·Jianlong QiGregory Butler
Nov 29, 2013·Bioinformatics·Hari Krishna YalamanchiliJunwen Wang
Jun 17, 2014·Bioinformatics·Matthew E StudhamErik L L Sonnhammer
Oct 16, 2014·Genome Biology·Paul C BoutrosGustavo Stolovitzky
Jan 17, 2012·Wiley Interdisciplinary Reviews. Systems Biology and Medicine·Celine LefebvreAndrea Califano
Oct 22, 2010·Environmental Toxicology and Chemistry·Edward J PerkinsAlexandre Loguinov
Feb 12, 2011·Plant, Cell & Environment·Mikaël LucasMalcolm Bennett
May 25, 2013·IEEE/ACM Transactions on Computational Biology and Bioinformatics·Daniele MuraroJohn King
Oct 26, 2011·IEEE/ACM Transactions on Computational Biology and Bioinformatics·Lipi AcharyaDongxiao Zhu
Nov 5, 2014·Frontiers in Cell and Developmental Biology·Frank Emmert-StreibBenjamin Haibe-Kains
Sep 13, 2014·PloS One·Sisi MaAlexander Statnikov
Aug 6, 2014·PloS One·S M Minhaz Ud-Dean, Rudiyanto Gunawan
Jul 16, 2016·Nature Reviews. Genetics·Julio Saez-RodriguezGustavo Stolovitzky
Feb 7, 2016·Seminars in Cell & Developmental Biology·Narsis A KianiJesper Tegnér
Nov 5, 2016·Proceedings of the National Academy of Sciences of the United States of America·Drew G MichaelMichael R Brent
Dec 16, 2016·Nature Reviews. Cancer·Andrea Califano, Mariano J Alvarez
Apr 1, 2016·PloS One·Samantha RiccadonnaCesare Furlanello
Jan 28, 2017·EURASIP Journal on Bioinformatics & Systems Biology·Oyetunji E OgundijoXiaodong Wang
Dec 22, 2015·Molecular BioSystems·Jun WuZhifeng Shao
Jan 1, 2013·Cells·Alejandro F VillaverdeJulio R Banga
Dec 1, 2017·Bioinformatics·Phan Nguyen, Rosemary Braun
Apr 15, 2016·IEEE/ACM Transactions on Computational Biology and Bioinformatics·Maziyar Baran Pouyan, Mehrdad Nourani
Sep 13, 2019·Bioinformatics·Torsten GrossNils Blüthgen
Feb 23, 2018·Scientific Reports·Vân Anh Huynh-Thu, Pierre Geurts
Jan 7, 2020·Journal of Computational Biology : a Journal of Computational Molecular Cell Biology·Mehmet Eren AhsenGustavo Stolovitzky
Mar 18, 2020·Molecular Systems Biology·Sean R HackettR Scott McIsaac
Sep 8, 2016·BMC Systems Biology·David M Budden, Edmund J Crampin
Jul 16, 2014·EURASIP Journal on Bioinformatics & Systems Biology·Peng LiChaoyang Zhang
Oct 27, 2018·PeerJ·Alina Frolova, Bartek Wilczyński
Dec 31, 2018·BMC Bioinformatics·Phan Nguyen, Rosemary Braun
Aug 9, 2015·Briefings in Bioinformatics·Fan ZhuYuanfang Guan
May 18, 2018·Proceedings of the National Academy of Sciences of the United States of America·Kranthi VaralaGloria M Coruzzi
Jan 1, 2015·F1000Research·Thomas CokelaerJulio Saez-Rodriguez
Oct 27, 2020·Nucleic Acids Research·Adam B Zaborowski, Dirk Walther

Related Concepts

BCOR protein, human
Proto-Oncogene Proteins
Repressor Molecules
Computer Programs and Programming
Disease Clustering
Computational Molecular Biology
Cdna Microarrays
Reverse Two-Hybrid System Techniques
MRNA Differential Display
Protein Interaction Mapping

Related Feeds

CZI Human Cell Atlas Seed Network

The aim of the Human Cell Atlas (HCA) is to build reference maps of all human cells in order to enhance our understanding of health and disease. The Seed Networks for the HCA project aims to bring together collaborators with different areas of expertise in order to facilitate the development of the HCA. Find the latest research from members of the HCA Seed Networks here.

Related Papers

Journal of Computational Biology : a Journal of Computational Molecular Cell Biology
Daniel MarbachDario Floreano
Proceedings of the National Academy of Sciences of the United States of America
Daniel MarbachGustavo Stolovitzky
Annals of the New York Academy of Sciences
Alan ScheinineAlberto de la Fuente
Annals of the New York Academy of Sciences
Angela BarallaAlberto de la Fuente
© 2021 Meta ULC. All rights reserved