The promise and pitfalls of systematic reviews

Annual Review of Public Health
Patricia Dolan Mullen, Gilbert Ramírez

Abstract

The systematic review "movement" that has transformed medical journal reports of clinical trials and reviews of clinical trials has taken hold in public health, with the most recent milestone, the publication of the first edition of The Guide to Community Health Services in 2005. In this paper we define and distinguish current terms, point out important resources for systematic reviews, describe the impact of systematic review on the quality of primary studies and summaries of the evidence, and provide perspectives on the promise of systematic reviews for shaping the agenda for public health research. Several pitfalls are discussed, including a false sense of rigor implied by the terms "systematic review" and "meta-analysis" and substantial variation in the validity of claims that a particular intervention is "evidence based," and the difficulty of translating conclusions from systematic reviews into public health advocacy and practice.

References

Aug 1, 1977·The American Psychologist·R G Meyer, S R Smith
Jul 1, 1990·Annals of Internal Medicine·R B HaynesM J Gardner
Apr 1, 1988·Annals of Internal Medicine·C D MulrowJ A Pugh
Mar 1, 1987·Annals of Internal Medicine·C D Mulrow
Nov 1, 1981·Journal of Learning Disabilities·K A Kavale, G V Glass
Jan 1, 1995·Psychological Bulletin·V Hasselblad, L V Hedges
Sep 3, 1994·BMJ : British Medical Journal·C D Mulrow
Jan 1, 1994·Gastrointestinal Endoscopy·D K Driman, R H Riddell
Mar 19, 1994·British Dental Journal·H Cooper
Dec 27, 1995·JAMA : the Journal of the American Medical Association·D Moher, I Olkin
Aug 3, 1996·BMJ : British Medical Journal·K LindeD Melchart
Feb 1, 1996·Controlled Clinical Trials·A R JadadH J McQuay
Aug 28, 1996·JAMA : the Journal of the American Medical Association·C BeggD F Stroup
Jul 1, 1997·American Journal of Public Health·M E NorthridgeM W Susser
Nov 4, 1992·Journal of Health Economics·A WagstaffB Nolan
Sep 4, 1999·American Journal of Public Health·R E GlasgowS M Boles
Sep 24, 1999·JAMA : the Journal of the American Medical Association·P JüniM Egger
Sep 27, 2000·Journal of Clinical Epidemiology·D MoherA Liberati
Feb 17, 2001·Statistics in Medicine·D R Elbourne, M K Campbell
Feb 24, 2001·Psychological Science·R L RosnowD B Rubin
Apr 17, 2001·Annals of Internal Medicine·D G AltmanUNKNOWN CONSORT GROUP (Consolidated Standards of Reporting Trials)
Apr 20, 2001·JAMA : the Journal of the American Medical Association·D MoherUNKNOWN CONSORT Group (Consolidated Standards of Reporting Trials)
Apr 27, 2001·American Journal of Health Behavior·L W Green
Sep 19, 2001·JAMA : the Journal of the American Medical Association·P WhitingG Ramírez
Sep 27, 2001·JAMA : the Journal of the American Medical Association·P G ShekelleS H Woolf
Oct 31, 2001·Public Health Nutrition·S Miilunpalo
Jan 29, 2002·Journal of Epidemiology and Community Health·L RychetnikA Shiell
Mar 28, 2002·International Journal of Obesity and Related Metabolic Disorders : Journal of the International Association for the Study of Obesity·A M Sharma
May 4, 2002·American Journal of Preventive Medicine·Evelyn P WhitlockJanet Allan
Jul 3, 2002·American Journal of Preventive Medicine·Russell E GlasgowDavid A Dzewaltowski
Jul 11, 2002·Journal of Acquired Immune Deficiency Syndromes : JAIDS·Larry V HedgesEllen Sogolow
Jul 11, 2002·Journal of Acquired Immune Deficiency Syndromes : JAIDS·Wayne D JohnsonEllen Sogolow
Oct 18, 2002·Journal of Clinical Epidemiology·Sebastian SchneeweissRobert J Glynn
Nov 5, 2003·Canadian Journal of Experimental Psychology = Revue Canadienne De Psychologie Expérimentale·Ralph L Rosnow
Nov 5, 2003·Psychological Methods·Lawrence D Cohn, Betsy J Becker
Dec 4, 2003·Annals of Behavioral Medicine : a Publication of the Society of Behavioral Medicine·Karina W DavidsonEvelyn P Whitlock
Feb 26, 2004·Annals of Behavioral Medicine : a Publication of the Society of Behavioral Medicine·Russell E GlasgowPaul Estabrooks

❮ Previous
Next ❯

Citations

Mar 11, 2008·The Journal of Nursing Administration·Robin P Newhouse
May 23, 2008·Journal of Wound, Ostomy, and Continence Nursing : Official Publication of the Wound, Ostomy and Continence Nurses Society·Sandra Engberg
Mar 20, 2009·Annual Review of Public Health·Ross C BrownsonChristopher M Maylahn
Apr 27, 2010·BMC Medical Research Methodology·Laura J RosenElliot Rosenberg
Apr 9, 2010·BMC Cancer·Myeong Soo LeeEdzard Ernst
Oct 28, 2008·The International Journal of Behavioral Nutrition and Physical Activity·Lisa J Harnack, Simone A French
Dec 27, 2007·PloS One·Beverley J SheaJeremy M Grimshaw
Sep 16, 2011·The American Journal of Clinical Nutrition·Douglas L WeedPamela J Mink
Jun 23, 2012·Preventing Chronic Disease·Julie A JacobsRoss C Brownson
Nov 4, 2015·Vaccines·Liam PowlesMagdalena Plebanski
Sep 21, 2012·American Journal of Preventive Medicine·Karyn PophamPatricia Dolan Mullen
Feb 22, 2012·American Journal of Preventive Medicine·Cam T EscofferyMaria E Fernandez
Jan 9, 2010·Journal of Clinical Epidemiology·Laura J Rosen, Michal Ben Noach
May 5, 2007·American Journal of Preventive Medicine·Klaus GebelMark Petticrew
Nov 1, 2009·Journal of Evidence-based Medicine·Gilbert Ramírez
Apr 26, 2007·Journal of Forensic Sciences·Iain A Pretty
Jun 8, 2007·Worldviews on Evidence-based Nursing·Jan ReedBrendan McCormack
Nov 23, 2006·Journal of Clinical Psychology·Bonnie SpringDonald Hedeker
Jun 10, 2011·Journal of Public Health Dentistry·L Kay Bartholomew, Patricia Dolan Mullen
Jan 11, 2007·Air Medical Journal·Cheryl Bagley Thompson, Edward A Panacek
Jan 12, 2010·Injury·Natalie M Spearing, Luke B Connelly
Mar 1, 2014·Western Journal of Nursing Research·Vicki S Conn, Tamara G Coon Sells
Apr 14, 2018·Journal of American College Health : J of ACH·Megan S Patterson, Patricia Goodson
Dec 18, 2007·Haemophilia : the Official Journal of the World Federation of Hemophilia·A TagliaferriC Pattacini
Apr 5, 2018·Journal of the National Cancer Institute·Douglas L Weed
Feb 26, 2016·BMC Medical Research Methodology·Laura Rosen, Ruth Suhami
Mar 30, 2016·AIMS Public Health·Kara Schick-MakaroffWendy Neander
Jun 29, 2021·Journal of Diabetes and Metabolic Disorders·Hamideh MoosapourBagher Larijani
Apr 20, 2013·The American Journal of Occupational Therapy : Official Publication of the American Occupational Therapy Association·Sally BennettLeigh Tooth

❮ Previous
Next ❯

Software Mentioned

RE
JAMA
CONSORT
Excel
TREND
AIM

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.