Evaluating the surgery literature: can standardizing peer-review today predict manuscript impact tomorrow?

Annals of Surgery
Julie Ann SosaSanziana A Roman


Evidence-based surgery is predicated on the quality of published literature. We measured the quality of surgery manuscripts selected by peer review and identified predictors of excellence. One hundred twenty clinical surgery manuscripts were randomly selected from 1998 in 5 eminent peer-reviewed surgery and medical journals. Manuscripts were blinded for author, institution, and journal of origin. Four surgeons and 4 methodologists evaluated the quality using novel instruments based on subject selection, study protocol, statistical analysis/inference, intervention description, outcome assessments, and results presentation. Predictors of quality and impact factor were identified using bivariate and multivariate regression. Oncology was the most common subject (26%), followed by general surgery/gastrointestinal (24%). The average number of study subjects was 417; the majority of manuscripts were American (53%), from a single institution (59%). Eighteen percent had a statistician author. Mean number of citations was 128. Surgery manuscripts from medical, compared with surgery journals, had better total quality scores (3.8 vs. 5.2, P < 0.001). They had more subjects and were more likely to have a statistician as coauthor (43% vs. 10...Continue Reading


Mar 9, 1990·JAMA : the Journal of the American Medical Association·D A Kronick
Jul 1, 1996·Journal of Clinical Epidemiology·D C HadornN Hicks
Feb 1, 1996·Controlled Clinical Trials·A R JadadH J McQuay
Jul 24, 1998·JAMA : the Journal of the American Medical Association·F GodleeC N Martyn
Jul 24, 1998·JAMA : the Journal of the American Medical Association·A C JusticeD Rennie
Nov 21, 1998·Journal of General Internal Medicine·S N GoodmanS L George
May 15, 2002·Diseases of the Colon and Rectum·Clifford Y KoArlene Fink
Jun 1, 2002·JAMA : the Journal of the American Medical Association·Tom JeffersonFrank Davidoff
Jun 1, 2002·JAMA : the Journal of the American Medical Association·Kirby P LeeLisa A Bero
Aug 23, 2002·Annals of Emergency Medicine·Michael L Callaham, David L Schriger
Sep 5, 2002·World Journal of Surgery·Ramesh PaladuguLeslie Wise
Dec 21, 2002·BMJ : British Medical Journal·William B Weeks, Amy E Wallace
Jul 29, 2004·Journal of the American Academy of Dermatology·Kenneth A KatzDavid J Margolis
Feb 18, 2006·ANZ Journal of Surgery·John C Hall
Feb 28, 2006·Journal of the American College of Surgeons·Jibby E Kurichi, Seema S Sonnad
Feb 1, 2007·Academic Medicine : Journal of the Association of American Medical Colleges·Arnold R Eiser, Glenn Ellis
Jan 8, 2008·Journal of the American Board of Family Medicine : JABFM·Donald E PathmanWarren P Newton
Jan 12, 2008·International Journal of Methods in Psychiatric Research·David Berle, Vladan Starcevic


Jun 29, 2013·Accountability in Research·Adedayo A OnitiloSuhail A R Doi
Nov 19, 2010·PloS One·Ronan W GlynnKarl J Sweeney
Nov 16, 2013·Accountability in Research·Adedayo A OnitiloSuhail A R Doi

Related Concepts

Peer Review
Electronic Publishing
Surgery Specialty
Peer Review, Publishing
Journal Impact Factor
Clinical Trials
Laser Surgery
Multi-Institutional Systems
Peer Review

Trending Feeds


Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Systemic Juvenile Idiopathic Arthritis

Systemic juvenile idiopathic arthritis is a rare rheumatic disease that affects children. Symptoms include joint pain, but also fevers and skin rashes. Here is the latest on this disease.

Chromatin Regulation and Circadian Clocks

The circadian clock plays an important role in regulating transcriptional dynamics through changes in chromatin folding and remodelling. Discover the latest research on Chromatin Regulation and Circadian Clocks here.

Central Pontine Myelinolysis

Central Pontine Myelinolysis is a neurologic disorder caused most frequently by rapid correction of hyponatremia and is characterized by demyelination that affects the central portion of the base of the pons. Here is the latest research on this disease.

Myocardial Stunning

Myocardial stunning is a mechanical dysfunction that persists after reperfusion of previously ischemic tissue in the absence of irreversible damage including myocardial necrosis. Here is the latest research.

Pontocerebellar Hypoplasia

Pontocerebellar hypoplasias are a group of neurodegenerative autosomal recessive disorders with prenatal onset, atrophy or hypoplasia of the cerebellum, hypoplasia of the ventral pons, microcephaly, variable neocortical atrophy and severe mental and motor impairments. Here is the latest research on pontocerebellar hypoplasia.

Cell Atlas Along the Gut-Brain Axis

Profiling cells along the gut-brain axis at the single cell level will provide unique information for each cell type, a three-dimensional map of how cell types work together to form tissues, and insights into how changes in the map underlie health and disease of the GI system and its crosstalk with the brain. Disocver the latest research on single cell analysis of the gut-brain axis here.

Chronic Traumatic Encephalopathy

Chronic Traumatic Encephalopathy (CTE) is a progressive degenerative disease that occurs in individuals that suffer repetitive brain trauma. Discover the latest research on traumatic encephalopathy here.