Measuring intrarater association between correlated ordinal ratings.

Biometrical Journal. Biometrische Zeitschrift
Kerrie P NelsonDon Edwards

Abstract

Variability between raters' ordinal scores is commonly observed in imaging tests, leading to uncertainty in the diagnostic process. In breast cancer screening, a radiologist visually interprets mammograms and MRIs, while skin diseases, Alzheimer's disease, and psychiatric conditions are graded based on clinical judgment. Consequently, studies are often conducted in clinical settings to investigate whether a new training tool can improve the interpretive performance of raters. In such studies, a large group of experts each classify a set of patients' test results on two separate occasions, before and after some form of training with the goal of assessing the impact of training on experts' paired ratings. However, due to the correlated nature of the ordinal ratings, few statistical approaches are available to measure association between raters' paired scores. Existing measures are restricted to assessing association at just one time point for a single screening test. We propose here a novel paired kappa to provide a summary measure of association between many raters' paired ordinal assessments of patients' test results before versus after rater training. Intrarater association also provides valuable insight into the consistency o...Continue Reading

References

Jan 1, 1988·Journal of Clinical Epidemiology·W D Thompson, S D Walter
Aug 1, 1987·American Journal of Epidemiology·M Maclure, W C Willett
Sep 1, 1993·Journal of Clinical Epidemiology·P Graham, R Jackson
Jan 29, 2000·Statistics in Medicine·A DonnerE Bartfay
Aug 23, 2003·Biostatistics·J M WilliamsonA K Manatunga
Aug 4, 2005·The Breast : Official Journal of the European Society of Mastology·S CiattoA Scorsolini
Jul 13, 2006·Statistics in Medicine·David TodemEmmanuel Lesaffre
Nov 23, 2006·AJR. American Journal of Roentgenology·Stephen H TaplinConstance D Lehman
Sep 7, 2007·Alzheimer Disease and Associated Disorders·Márcia Lorena Fagundes ChavesJeffrey Kaye
Mar 20, 2010·Breast Cancer Research and Treatment·Anna Liza M Antonio, Catherine M Crespi
Feb 5, 2011·Journal of Clinical Epidemiology·Chuhsing K HsiaoWen-Hsin Kao
Apr 16, 2011·Radiology·Valencia KingElizabeth A Morris
Jun 28, 2012·Statistics in Medicine·Sophie VanbelleEmmanuel Lesaffre
Jan 24, 2015·Journal of Speech, Language, and Hearing Research : JSLHR·Jill GilkersonKeith Topping
Mar 18, 2015·JAMA : the Journal of the American Medical Association·Joann G ElmoreDonald L Weaver
Jun 23, 2015·Statistics in Medicine·Kerrie P Nelson, Don Edwards
Feb 19, 2016·Biometrical Journal. Biometrische Zeitschrift·Hongyuan CaoEvan S Dellon
May 18, 2016·Statistical Methods in Medical Research·Kerrie P Nelson, Don Edwards
Nov 8, 2017·Biometrical Journal. Biometrische Zeitschrift·Luca GrassanoMauro Gasparini
Aug 1, 2016·Educational and Psychological Measurement·Kilem L Gwet

❮ Previous
Next ❯

Related Concepts

Related Feeds

Alzheimer's Disease: Neuroimaging

Neuroimaging can help identify pathological hallmarks of Alzheimer's disease (AD). Here is the latest research on neuroimaging modalities, including magnetic resonance imaging and positron emission tomography, in AD.