Interrater reliability and convergent validity of the American Academy for Cerebral Palsy and Developmental Medicine methodology for conducting systematic reviews

Developmental Medicine and Child Neurology
Lesley WiartIrina Dinu

Abstract

The aim of this study was to evaluate the interrater reliability and convergent validity of the American Academy for Cerebral Palsy and Developmental Medicine's (AACPDM) methodology for conducting systematic reviews (group design studies). Four clinicians independently rated 24 articles for the level of evidence and conduct using AACPDM methodology. Study conduct was also assessed using the Effective Public Health Practice Project scale. Raters were randomly assigned to one of two pairs to resolve discrepancies. The level of agreement between individual raters and pairs was calculated using kappa (α=0.05) and intraclass correlations (ICCs; α=0.05). Spearman's rank correlation coefficient was calculated to evaluate the relationship between raters' categorization of quality categories using the two tools. There was acceptable agreement between raters (κ=0.77; p<0.001; ICC=0.90) and between assigned pairs (κ=0.83; p<0.001; ICC=0.96) for the level of evidence ratings. There was acceptable agreement between pairs for four of the seven conduct questions (κ=0.53-0.87). ICCs (all raters) for conduct category ratings (weak, moderate, and strong) also indicated good agreement (ICC=0.76). Spearman's rho indicated a significant positive co...Continue Reading

References

May 1, 1993·Journal of Clinical Epidemiology·T ByrtJ B Carlin
Mar 1, 1997·Annals of Internal Medicine·D J CookR B Haynes
Mar 6, 1999·Developmental Medicine and Child Neurology·C ButlerJ Darrah
May 17, 2000·Journal of Clinical Epidemiology·F K Hoehler
Jun 8, 2001·Journal of the American Academy of Child and Adolescent Psychiatry·G A MorganR J Harmon
Sep 23, 2003·Health Technology Assessment : HTA·J J DeeksUNKNOWN European Carotid Surgery Trial Collaborative Group
Dec 13, 2007·Physical Therapy·Susan Armijo OlivoDavid J Magee
Jan 19, 2008·Developmental Medicine and Child Neurology·Lynne Romeiser LoganCarolyn B Heriza
May 17, 2008·The British Journal of Mathematical and Statistical Psychology·Kilem Li Gwet

❮ Previous
Next ❯

Citations

Dec 21, 2013·Pediatric Physical Therapy : the Official Publication of the Section on Pediatrics of the American Physical Therapy Association·Anna Weber, Kathy Martin
Aug 26, 2014·American Journal on Intellectual and Developmental Disabilities·Stephanie Yoshiko Shire, Connie Kasari
May 30, 2013·Disability and Rehabilitation. Assistive Technology·Stephanie M N GleggLiisa Holsti
Sep 10, 2015·Physiotherapy Research International : the Journal for Researchers and Clinicians in Physical Therapy·Kylee Tustin, Anita Patel
Aug 18, 2017·Developmental Medicine and Child Neurology·Irene MollR Jeroen Vermeulen
Sep 4, 2013·Developmental Medicine and Child Neurology·Roslyn Livingstone, Ginny Paleg
Jul 6, 2019·Child: Care, Health and Development·Amanda Marie BlackmoreAndrew C Wilson
Mar 29, 2014·Developmental Medicine and Child Neurology·Megan L AuldLeanne M Johnston
Feb 19, 2019·Journal of Foot and Ankle Research·Elizabeth WojciechowskiJoshua Burns
Mar 31, 2016·Developmental Medicine and Child Neurology·Catherine MorganLinda Fetters
Dec 8, 2016·Developmental Medicine and Child Neurology·Mijna Hadders-AlgraElisa G Hamer
May 26, 2017·Developmental Medicine and Child Neurology·Robbin HickmanJanet S Dufek
Jun 3, 2017·Developmental Medicine and Child Neurology·Stacey D MillerKishore Mulpuri
Dec 30, 2020·Physical & Occupational Therapy in Pediatrics·Maria A Fragala-PinkhamLynn M Jeffries
Aug 27, 2021·Disability and Rehabilitation. Assistive Technology·C M HospodarS W Logan

❮ Previous
Next ❯

Related Concepts

Related Feeds

Birth Defects

Birth defects encompass structural and functional alterations that occur during embryonic or fetal development and are present since birth. The cause may be genetic, environmental or unknown and can result in physical and/or mental impairment. Here is the latest research on birth defects.

Related Papers

Indian Journal of Community Medicine : Official Publication of Indian Association of Preventive & Social Medicine
Kapil YadavKiran Goswami
Pharmacoepidemiology and Drug Safety
Becky A BriesacherJerry H Gurwitz
The Australian Journal of Physiotherapy
Robert D Herbert
© 2021 Meta ULC. All rights reserved