Issues in bioinformatics benchmarking: the case study of multiple sequence alignment.

Nucleic Acids Research
Mohamed Radhouene AnibaJulie D Thompson

Abstract

The post-genomic era presents many new challenges for the field of bioinformatics. Novel computational approaches are now being developed to handle the large, complex and noisy datasets produced by high throughput technologies. Objective evaluation of these methods is essential (i) to assure high quality, (ii) to identify strong and weak points of the algorithms, (iii) to measure the improvements introduced by new methods and (iv) to enable non-specialists to choose an appropriate tool. Here, we discuss the development of formal benchmarks, designed to represent the current problems encountered in the bioinformatics field. We consider several criteria for building good benchmarks and the advantages to be gained when they are used intelligently. To illustrate these principles, we present a more detailed discussion of benchmarks for multiple alignments of protein sequences. As in many other domains, significant progress has been achieved in the multiple alignment field and the datasets have become progressively more challenging as the existing algorithms have evolved. Finally, we propose directions for future developments that will ensure that the bioinformatics benchmarks correspond to the challenges posed by the high throughput...Continue Reading

References

Dec 1, 1988·Journal of Molecular Evolution·W R Taylor
Jun 1, 1995·Protein Science : a Publication of the Protein Society·W R Pearson
Apr 15, 1996·Nucleic Acids Research·C Notredame, D G Higgins
Jun 15, 1996·Genomics·M Burset, R Guigó
Jun 1, 1997·Current Opinion in Structural Biology·S E BrennerT J Hubbard
Jun 2, 1998·Bioinformatics·J StoyeF Meyer
Nov 25, 1998·Protein Science : a Publication of the Protein Society·K MizuguchiJ P Overington
Jun 22, 1999·Nucleic Acids Research·J D ThompsonO Poch
Aug 31, 2000·Journal of Molecular Biology·C NotredameJ Heringa
Dec 26, 2001·Nucleic Acids Research·Alex BatemanErik L L Sonnhammer
Apr 6, 2002·Bioinformatics·Christopher LeeMark F Sharlow
Jul 24, 2002·Nucleic Acids Research·Kazutaka KatohTakashi Miyata
Jun 5, 2003·Proteins·Rong ChenZhiping Weng
Oct 14, 2003·BMC Bioinformatics·G P S RaghavaGeoffrey J Barton
Nov 25, 2003·Nature Structural Biology·Helen BermanHaruki Nakamura
Jan 23, 2004·BMC Bioinformatics·Daniel A PollardMichael B Eisen
Feb 13, 2004·Bioinformatics·Leslie M CopeTerence P Speed
Mar 23, 2004·Nucleic Acids Research·Robert C Edgar
Jun 18, 2004·Journal of Molecular Biology·Orla O'SullivanCédric Notredame
Feb 3, 2005·Genome Research·Chuong B DoSerafim Batzoglou
Feb 11, 2005·Journal of Molecular Biology·Rachel KolodnyMichael Levitt
Mar 24, 2005·BMC Bioinformatics·Amarendran R SubramanianBurkhard Morgenstern
Apr 30, 2005·Nucleic Acids Research·Paul P GardnerStefan Washietl
Jul 8, 2005·Proceedings of the National Academy of Sciences of the United States of America·Ari Löytynoja, Nick Goldman
Jul 27, 2005·Proteins·Julie D ThompsonOlivier Poch
May 19, 2006·Nucleic Acids Research·Saikat ChakrabartiStephen H Bryant
Oct 26, 2006·Algorithms for Molecular Biology : AMB·Andreas WilmGerhard Steger
Dec 5, 2006·Nucleic Acids Research·Paolo SonegoSándor Pongor
Jan 24, 2007·Current Biology : CB·Sebastian MeierSuat Ozbek
Aug 10, 2007·Bioinformatics·Hyrum CarrollDavid McClellan
Sep 12, 2007·Bioinformatics·M A LarkinD G Higgins
Nov 15, 2007·Nucleic Acids Research·Antonina AndreevaAlexey G Murzin
Feb 12, 2008·Trends in Genetics : TIG·Mihai Pop, Steven L Salzberg
Mar 11, 2008·Current Opinion in Structural Biology·Richard A Goldstein
Mar 28, 2008·Proceedings of the National Academy of Sciences of the United States of America·Robbyn L TuinstraBrian F Volkman
Apr 29, 2008·BMC Bioinformatics·Emmanuel PerrodouJulie D Thompson

❮ Previous
Next ❯

Citations

Oct 11, 2011·Bioinformatics·Siavash Mirarab, Tandy Warnow
Jan 11, 2012·Nucleic Acids Research·Ionas ErbCédric Notredame
Nov 3, 2011·BMC Structural Biology·RyangGuk KimJun-tao Guo
Sep 17, 2014·Trends in Plant Science·Chuang MaXiangfeng Wang
Jan 7, 2015·Journal of Cellular Biochemistry·Matloob Khushi
Oct 13, 2011·Molecular Systems Biology·Fabian SieversDesmond G Higgins
Aug 21, 2012·Human Mutation·Preethy Sasidharan Nair, Mauno Vihinen
Jan 1, 2013·Intrinsically Disordered Proteins·Sandeep ChakrabortyBjarni Asgeirsson
May 17, 2011·Molecular Phylogenetics and Evolution·Dirk AhrensAlfried P Vogler
Jun 4, 2016·Bioinformatics·Ganapathi Varma SaripellaKristoffer Forslund
Mar 29, 2019·Nature Communications·Serghei MangulJonathan Flint
Jun 22, 2019·Genome Biology·Lukas M WeberMark D Robinson
Jan 2, 2019·BMC Bioinformatics·Yingying WangYunpeng Cai
Dec 29, 2020·Computational and Structural Biotechnology Journal·Nicholas A BokulichBenjamin D Kaehler

❮ Previous
Next ❯

Methods Mentioned

BETA
interaction prediction

Software Mentioned

CASP ( Critical Assessment of Techniques for Protein Structure...
3DCoffee
Probcons
Dialign
PRANK
SAGA
HOMSTRAD
POA
ClustalW
DaliLite

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.