A general modular framework for gene set enrichment analysis

BMC Bioinformatics
Marit Ackermann, Korbinian Strimmer


Analysis of microarray and other high-throughput data on the basis of gene sets, rather than individual genes, is becoming more important in genomic studies. Correspondingly, a large number of statistical approaches for detecting gene set enrichment have been proposed, but both the interrelations and the relative performance of the various methods are still very much unclear. We conduct an extensive survey of statistical approaches for gene set analysis and identify a common modular structure underlying most published methods. Based on this finding we propose a general framework for detecting gene set enrichment. This framework provides a meta-theory of gene set analysis that not only helps to gain a better understanding of the relative merits of each embedded approach but also facilitates a principled comparison and offers insights into the relative interplay of the methods. We use this framework to conduct a computer simulation comparing 261 different variants of gene set enrichment procedures and to analyze two experimental data sets. Based on the results we offer recommendations for best practices regarding the choice of effective procedures for gene set enrichment analysis.


Feb 24, 2001·The New England Journal of Medicine·I HedenfalkG Sauter
Apr 20, 2001·Proceedings of the National Academy of Sciences of the United States of America·V G TusherG Chu
Jun 30, 2001·The New England Journal of Medicine·O I Olopade, T Grushko
Mar 7, 2003·Genomics·Sorin DrăghiciStephen A Krawetz
Oct 2, 2003·Genome Biology·Douglas A HosackRichard A Lempicki
Dec 25, 2003·Bioinformatics·Jelle J GoemanHans C van Houwelingen
Jun 9, 2005·BMC Bioinformatics·Seon-Young Kim, David J Volsky
Aug 23, 2005·Methods of Information in Medicine·Ulrich Mansmann, R Meister
Sep 22, 2005·Proceedings of the National Academy of Sciences of the United States of America·Lu TianPeter J Park
Oct 4, 2005·Proceedings of the National Academy of Sciences of the United States of America·Aravind SubramanianJill P Mesirov
May 2, 2006·Statistical Applications in Genetics and Molecular Biology·Jörg RahnenführerThomas Lengauer
May 2, 2006·Statistical Applications in Genetics and Molecular Biology·Juliane Schäfer, Korbinian Strimmer
Nov 28, 2006·Bioinformatics·Zhen Jiang, Robert Gentleman
Feb 3, 2007·Bioinformatics·Serban NacuSusan Holmes
Feb 17, 2007·Bioinformatics·Jelle J Goeman, Peter Bühlmann
Apr 4, 2007·Statistical Applications in Genetics and Molecular Biology·Rainer Opgen-Rhein, Korbinian Strimmer
Jun 8, 2007·Bioinformatics·James J ChenChen-An Tsai
Jul 7, 2007·BMC Bioinformatics·I DinuY Yasui
Aug 9, 2007·BMC Bioinformatics·Andreas KellerHans-Peter Lenhof
Oct 13, 2007·Journal of Bioinformatics and Computational Biology·Lev KlebanovYuanhui Xiao
Oct 16, 2007·BMC Bioinformatics·Ricardo Z N Vêncio, Ilya Shmulevich
Nov 9, 2007·BMC Bioinformatics·Q LiuY Yasui
Nov 21, 2007·Bioinformatics·Manuela HummelUlrich Mansmann
Jan 19, 2008·Briefings in Bioinformatics·Dougu Nam, Seon-Young Kim
Mar 12, 2008·Journal of Computational Biology : a Journal of Computational Molecular Cell Biology·A J AdewaleY Yasui
Sep 16, 2008·Artificial Intelligence in Medicine·Joaquin Dopazo
Nov 29, 2008·BMC Bioinformatics·Sarah Song, Michael A Black
Apr 10, 2009·Biometrical Journal. Biometrische Zeitschrift·Jürgen LäuterEkkehard Glimm


Dec 25, 2012·Journal of Molecular Neuroscience : MN·Tomas KavanaghMichael Janitz
Mar 21, 2013·Journal of Neurotrauma·Jacob D FealaJaques Reifman
Feb 15, 2014·Advances in Wound Care·Tomasz ArodzRobert F Diegelmann
Sep 9, 2011·Briefings in Bioinformatics·Jui-Hung HungCharles DeLisi
Feb 19, 2009·Bioinformatics·Shuangge Ma, Michael R Kosorok
Aug 4, 2009·Bioinformatics·Verena Zuber, Korbinian Strimmer
Sep 9, 2010·Bioinformatics·Dougu Nam
Jul 9, 2010·Bioinformatics·Di WuGordon K Smyth
Oct 26, 2010·Bioinformatics·Johannes M FreudenbergMario Medvedovic
Apr 12, 2012·Bioinformatics·Haroon NaeemRobert Küffner
Oct 1, 2013·Bioinformatics·Kourosh ZarringhalamDaniel Ziemek
Apr 30, 2013·Molecular Biology and Evolution·Josephine T DaubLaurent Excoffier
Sep 25, 2012·Nucleic Acids Research·Paolo MartiniChiara Romualdi
May 15, 2013·Nucleic Acids Research·Gabriele SalesChiara Romualdi
Oct 29, 2010·EURASIP Journal on Bioinformatics & Systems Biology·Anthony Almudevar
Sep 24, 2009·BMC Bioinformatics·Phillip D Yates, Mark A Reimers
Jan 2, 2010·BMC Bioinformatics·Shuangge Ma, Michael R Kosorok
May 28, 2011·BMC Bioinformatics·Insuk SohnSin-Ho Jung
Jan 26, 2011·BMC Bioinformatics·Andre J FaureNicola J Mulder
Oct 28, 2011·BMC Bioinformatics·Vid PodpečanKristina Gruden
Nov 29, 2011·BMC Bioinformatics·Laila M PoissonDebashis Ghosh
Jun 21, 2012·BMC Bioinformatics·Adi Laurentiu TarcaRoberto Romero
Jul 18, 2012·BMC Bioinformatics·David EdwardsPeter Sørensen
Feb 2, 2012·BMC Bioinformatics·Gabriele SalesChiara Romualdi
Feb 22, 2012·BMC Bioinformatics·Leonid ChindelevitchDaniel Ziemek
Aug 10, 2013·BMC Bioinformatics·Ajay Anand KumarPetri Törönen
Oct 20, 2010·BMC Genomics·Daniel M GattiFred A Wright
Apr 7, 2010·Human Genomics·Hannah Tipney, Lawrence Hunter
Jan 17, 2012·Algorithms for Molecular Biology : AMB·Hirokazu MatsudaHiroaki Iwaisaki
Feb 26, 2014·BMC Systems Biology·Vicky WangDaniel Ziemek
Oct 25, 2011·Genome Biology·Svitlana TyekuchevaGiovanni Parmigiani
Jul 31, 2013·Genome Medicine·Gabriel M AltschulerWinston A Hide
Dec 1, 2011·Journal of the American Statistical Association·Lin S ChenPei Wang
Jun 4, 2011·PLoS Computational Biology·Frank Emmert-Streib, Galina Glazko
Dec 7, 2011·PLoS Computational Biology·Lukas Käll, Olga Vitek
Feb 1, 2012·PLoS Computational Biology·Xinan YangYves A Lussier
Mar 3, 2012·PLoS Computational Biology·Purvesh KhatriAtul J Butte
Dec 4, 2009·PloS One·Jigang ZhangHong-Wen Deng
Nov 11, 2011·PloS One·Ahmed E EnayetallahClaire M Steppan
May 26, 2012·PloS One·Shailesh Tripathi, Frank Emmert-Streib
Nov 29, 2013·International Journal of Molecular Sciences·Paolo MartiniStefano Cagnin
Aug 1, 2014·BMC Bioinformatics·Paolo MartiniChiara Romualdi
Jul 18, 2014·BMC Systems Biology·Polina ReshetovaJohan A Westerhuis
Feb 4, 2014·Bioinformatics·Jun Hu, Jung-Ying Tzeng
May 2, 2014·Molecular Biology and Evolution·Julien RouxLaurent Keller
Apr 2, 2014·Reproduction : the Official Journal of the Society for the Study of Fertility·Caroline SchwarzerMichele Boiani
Nov 16, 2013·Trends in Plant Science·Seung Yon Rhee, Marek Mutwil
Feb 2, 2013·Advanced Drug Delivery Reviews·Haisu Ma, Hongyu Zhao
Feb 16, 2013·Briefings in Bioinformatics·Henryk Maciejewski
Apr 29, 2014·Nucleic Acids Research·Yi WangYong Q Gu
Aug 21, 2013·Bioinformatics·Robert MaierRobert Küffner
Jan 21, 2016·Bioinformatics·Daniel StöckelHans-Peter Lenhof
Feb 3, 2016·Bioinformatics·Florian SchmidHans A Kestler
Feb 8, 2016·Brain Structure & Function·Sudheer GiddaluruLars Nyberg
Jan 7, 2016·Frontiers in Physiology·Miguel A García-CamposEnrique Hernández-Lemus
Dec 6, 2014·BMC Bioinformatics·Yasir RahmatallahGalina Glazko
Oct 10, 2015·IEEE/ACM Transactions on Computational Biology and Bioinformatics·H Robert FrostJason H Moore
Jun 5, 2015·Scientific Reports·Ya-Hsuan ChangPan-Chyr Yang
Oct 18, 2012·Journal of the Royal Statistical Society. Series B, Statistical Methodology·Jianqing FanXin Tong
Jun 21, 2012·Genetic Epidemiology·Janina S RiedChristian Gieger
Dec 14, 2011·Genetic Epidemiology·Daniel J SchaidRichard M Weinshilboum
Jun 22, 2010·American Journal of Human Genetics·Lin S ChenLi Hsu
Aug 25, 2015·BioData Mining·H Robert FrostJason H Moore
Jul 15, 2015·Genome Medicine·Shelley M MacNeilAndrea H Bild
Oct 12, 2010·American Journal of Obstetrics and Gynecology·Mari LøsetRigmor Austgulen
May 15, 2015·Metabolomics : Official Journal of the Metabolomic Society·Alexander KaeverPeter Meinicke
Jan 23, 2013·Bioorganic & Medicinal Chemistry Letters·Hans-Christoph Schneider, Thomas Klabunde
Apr 29, 2015·Annual Review of Statistics and Its Application·Michael A Newton, Zhishi Wang
Jul 6, 2014·European Journal of Human Genetics : EJHG·Jinying ZhaoMomiao Xiong
Sep 3, 2010·BMC Systems Biology·Maria Sofia MassaChiara Romualdi
Dec 3, 2015·Journal of Cellular Biochemistry·A Koskela von SydowM Ivarsson
Mar 20, 2015·PloS One·Ngoc-Thuy HaHenner Simianer
Mar 1, 2016·Statistics in Medicine·Monika JelizarowJelle J Goeman
Jun 26, 2015·PLoS Computational Biology·Boris P HejblumRodolphe Thiébaut
May 18, 2016·Journal of the American Statistical Association·Jianqing FanXin Tong
Oct 8, 2016·BMC Bioinformatics·Junli DuYulin Chen
May 1, 2015·BMC Bioinformatics·Jessica L Larson, Art B Owen
Jan 24, 2017·Food and Chemical Toxicology : an International Journal Published for the British Industrial Biological Research Association·Justyna SzostakJ Hoeng
Aug 31, 2016·Cold Spring Harbor Protocols·Jui-Hung Hung, Zhiping Weng
Feb 11, 2012·Bioinformatics·Yufei XiaoYidong Chen
May 26, 2017·Evolution; International Journal of Organic Evolution·Kyle M BenowitzAllen J Moore
Mar 4, 2015·Statistical Methods in Medical Research·Dougu Nam
Jan 26, 2017·BMC Bioinformatics·Yasir RahmatallahGalina Glazko
Jan 1, 2010·Genes·Debashis Ghosh, Zhaohui S Qin
Sep 3, 2016·International Journal of Molecular Sciences·Julia WelzenbachChristine Große-Brinkhaus
Feb 22, 2014·Cancer Informatics·Jianping HuaEdward R Dougherty
Jul 19, 2016·Gene Regulation and Systems Biology·sbv IMPROVER project team and challenge best performersYang Xiang
Jul 21, 2016·Nature Communications·Blerida BanushiPaul Gissen
Oct 31, 2018·Molecular Omics·H StarobovaI Vetter
Dec 29, 2018·Research Synthesis Methods·Robin Kosch, Klaus Jung
Nov 19, 2010·Nature Reviews. Genetics·Kai WangHakon Hakonarson
Apr 3, 2019·PLoS Computational Biology·Hailong MengSteven H Kleinstein
Dec 28, 2017·Nature Reviews. Genetics·Marcin Cieślik, Arul M Chinnaiyan
Oct 11, 2019·Genome Biology·Tuan-Minh NguyenSorin Drăghici
Nov 28, 2012·BMC Bioinformatics·Marina BessarabovaYuri Nikolsky
Oct 3, 2019·Proceedings. Biological Sciences·Evan L MacLeanJames A Serpell
Oct 17, 2017·BMC Bioinformatics·Chenggang YuJaques Reifman
Jan 20, 2015·Nature Neuroscience·Network and Pathway Analysis Subgroup of Psychiatric Genomics Consortium
Sep 6, 2015·Briefings in Bioinformatics·Yasir RahmatallahGalina Glazko
Jun 18, 2017·PLoS Computational Biology·En-Yu LaiKun-Pin Wu
Oct 21, 2017·Statistics in Medicine·Wentao LuAdi Gazdar
Jun 9, 2018·BioData Mining·Ravi MathurAlison Motsinger-Reif
Oct 26, 2018·BMC Bioinformatics·Shu-Ju LinChuhsing Kate Hsiao
May 19, 2019·BMC Bioinformatics·Joanna RoderCarlos Oliveira
Jul 23, 2020·Frontiers in Genetics·Farhad MalekiAnthony J Kusalik
May 14, 2017·BMC Bioinformatics·Joanna ZylaJoanna Polanska
Jun 28, 2017·Current Protocols in Bioinformatics·Sidra Ahsan, Sorin Drăghici
Aug 29, 2019·Genetics·Palle Duun RohdeTorsten Nygaard Kristensen
Oct 10, 2020·GigaScience·Amy L CochranMelvin G McInnis

Related Concepts

In Silico
Two-Parameter Models
Cdna Microarrays
Online Mendelian Inheritance In Man
Meta-Analysis (Publications)
Gene Mutant

Related Feeds

Breast Cancer: BRCA1 & BRCA2

Mutations involving BRCA1, found on chromosome 17, and BRCA2, found on chromosome 13, increase the risk for specific cancers, such as breast cancer. Discover the last research on breast cancer BRCA1 and BRCA2 here.