PMID: 11914164Mar 27, 2002Paper

Inter-rater agreement in the scoring of abstracts submitted to a primary care research conference

BMC Health Services Research
Alan A MontgomeryTom Fahey

Abstract

Checklists for peer review aim to guide referees when assessing the quality of papers, but little evidence exists on the extent to which referees agree when evaluating the same paper. The aim of this study was to investigate agreement on dimensions of a checklist between two referees when evaluating abstracts submitted for a primary care conference. Anonymised abstracts were scored using a structured assessment comprising seven categories. Between one (poor) and four (excellent) marks were awarded for each category, giving a maximum possible score of 28 marks. Every abstract was assessed independently by two referees and agreement measured using intraclass correlation coefficients. Mean total scores of abstracts accepted and rejected for the meeting were compared using an unpaired t test. Of 52 abstracts, agreement between reviewers was greater for three components relating to study design (adjusted intraclass correlation coefficients 0.40 to 0.45) compared to four components relating to more subjective elements such as the importance of the study and likelihood of provoking discussion (0.01 to 0.25). Mean score for accepted abstracts was significantly greater than those that were rejected (17.4 versus 14.6, 95% CI for differen...Continue Reading

References

Jan 1, 1991·Journal of Clinical Epidemiology·A D OxmanD L Streiner
Nov 5, 1997·BMJ : British Medical Journal·R Smith
Jul 24, 1998·JAMA : the Journal of the American Medical Association·N BlackS Evans

❮ Previous
Next ❯

Citations

Mar 25, 2009·Journal of Children's Orthopaedics·Onur HapaAli Biçimoğlu
Mar 30, 2010·Journal of Clinical Nursing·Debby L GerritsenMiel W Ribbe
Oct 26, 2011·Catheterization and Cardiovascular Interventions : Official Journal of the Society for Cardiac Angiography & Interventions·Dong-Ho ShinPeter J Fitzgerald
Jul 31, 2012·Journal of Health Psychology·Carolyn J HeckmanStuart R Lessin
Nov 28, 2013·Knee Surgery, Sports Traumatology, Arthroscopy : Official Journal of the ESSKA·Hyung-Min JiYong-Chan Ha
Sep 8, 2015·Knee Surgery, Sports Traumatology, Arthroscopy : Official Journal of the ESSKA·Daniel WhelanPeter MacDonald
Sep 25, 2015·Environmental Science and Pollution Research International·Mohammad HoseiniKazem Naddafi
Jan 10, 2019·Clinical Orthopaedics and Related Research·Florian SchmaranzerSimon D Steppacher
Mar 1, 2019·Journal of Orthopaedic Surgery and Research·Simon Damian SteppacherMoritz Tannast
Jan 7, 2004·Plastic and Reconstructive Surgery·Lydia P E van der SteenStan J Monstrey
Jun 23, 2009·Journal of Orthopaedic Research : Official Publication of the Orthopaedic Research Society·Simon D SteppacherStephen B Murphy
Sep 20, 2011·Journal of General Internal Medicine·Jeremiah NewsomLisa Willett
May 21, 2016·Hospital Pediatrics·Alexander F GlickBenard P Dreyer
Jul 17, 2016·Aesthetic Plastic Surgery·Rafael DenadaiCassio Eduardo Raposo-Amaral
Jun 7, 2017·Environmental Science and Pollution Research International·Parinaz PoursafaRoya Kelishadi
Jan 23, 2018·Frontiers in Aging Neuroscience·Alexandru D IordanPatricia A Reuter-Lorenz
Dec 22, 2017·Australian Occupational Therapy Journal·Justin Newton ScanlanRachael McDonald
Apr 19, 2019·Clinical Orthopaedics and Related Research·Florian SchmaranzerGuoyan Zheng
Mar 21, 2006·BMC Medical Research Methodology·Brian H RoweAndrew Worster
Aug 7, 2012·Hip International : the Journal of Clinical and Experimental Research on Hip Pathology and Therapy·Claudia MaierClaudio Dora
Nov 30, 2018·European Journal of Orthopaedic Surgery & Traumatology : Orthopédie Traumatologie·Hiroshi ImaiHiromasa Miura
Jul 25, 2018·International Orthopaedics·Panayiotis D MegaloikonomosDimitrios Pasparakis
Mar 25, 2019·Knee Surgery, Sports Traumatology, Arthroscopy : Official Journal of the ESSKA·Woon-Hwa JungRamvilas Nag
Dec 7, 2018·Clinical Orthopaedics and Related Research·Florian SchmaranzerMoritz Tannast
Feb 26, 2008·Aging & Mental Health·D L GerritsenM W Ribbe
Jun 26, 2007·Clinical Orthopaedics and Related Research·John C ClohisyPerry L Schoenecker
Jun 10, 2003·Plastic and Reconstructive Surgery·Lydia P E van der SteenRiccardo Mazzola
Apr 10, 2012·Knee Surgery, Sports Traumatology, Arthroscopy : Official Journal of the ESSKA·Woon-hwa JungJae-Heon Jeong
Dec 23, 2016·Knee Surgery, Sports Traumatology, Arthroscopy : Official Journal of the ESSKA·Jun-Il YooKyung-Hoi Koo
Apr 26, 2015·Clinical Orthopaedics and Related Research·Robert PetrettaBassam A Masri
Dec 31, 2020·Clinical Orthopaedics and Related Research·Florian SchmaranzerEduardo N Novais

❮ Previous
Next ❯

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.

Related Papers

Colorectal Disease : the Official Journal of the Association of Coloproctology of Great Britain and Ireland
M J Kelly, W E G Thomas
The Journal of Maternal-fetal & Neonatal Medicine : the Official Journal of the European Association of Perinatal Medicine, the Federation of Asia and Oceania Perinatal Societies, the International Society of Perinatal Obstetricians
Anthony M VintzileosShahidul Islam
The Journal of Sports Medicine and Physical Fitness
G P RontoyannisA Vlastaris
© 2022 Meta ULC. All rights reserved