Development, inter-rater reliability and feasibility of a checklist to assess implementation (Ch-IMP) in systematic reviews: the case of provider-based prevention and treatment programs targeting children and youth
Abstract
Several papers report deficiencies in the reporting of information about the implementation of interventions in clinical trials. Information about implementation is also required in systematic reviews of complex interventions to facilitate the translation and uptake of evidence of provider-based prevention and treatment programs. To capture whether and how implementation is assessed within systematic effectiveness reviews, we developed a checklist for implementation (Ch-IMP) and piloted it in a cohort of reviews on provider-based prevention and treatment interventions for children and young people. This paper reports on the inter-rater reliability, feasibility and reasons for discrepant ratings. Checklist domains were informed by a framework for program theory; items within domains were generated from a literature review. The checklist was pilot-tested on a cohort of 27 effectiveness reviews targeting children and youth. Two raters independently extracted information on 47 items. Inter-rater reliability was evaluated using percentage agreement and unweighted kappa coefficients. Reasons for discrepant ratings were content analysed. Kappa coefficients ranged from 0.37 to 1.00 and were not influenced by one-sided bias. Most kappa ...Continue Reading
References
Citations
Software Mentioned
Related Concepts
Related Feeds
Carbapenems (ASM)
Carbapenems are members of the beta lactam class of antibiotics and are used for the treatment of severe or high-risk bacterial infections. Discover the latest research on carbapenems here.
Carbapenems
Carbapenems are members of the beta lactam class of antibiotics and are used for the treatment of severe or high-risk bacterial infections. Discover the latest research on carbapenems here.