Toward meaningful evaluation of clinical competence: the role of direct observation in clerkship ratings

Academic Medicine : Journal of the Association of American Medical Colleges
Memoona HasnainRachel Yudkowsky

Abstract

The lack of direct observation by faculty may affect meaningful judgments of clinical competence. The purpose of this study was to explore the influence of direct observation on reliability and validity evidence for family medicine clerkship ratings of clinical performance. Preceptors rating family medicine clerks (n = 172) on a 16-item evaluation instrument noted the data-source for each rating: note review, case discussion, and/or direct observation. Mean data-source scores were computed and categorized as low, medium or high, with the high-score group including the most direct observation. Analyses examined the influence of data-source on interrater agreement and associations between clerkship clinical scores (CCS) and scores from the National Board of Medical Examiners (NBME(R)) subject examination as well as a fourth-year standardized patient-based clinical competence examination (M4CCE). Interrater reliability increased as a function of data-source; for the low, medium, and high groups, intraclass correlation coefficients were.29,.50, and.74, respectively. For the high-score group, there were significant positive correlations between CCS and NBME score (r =.311, p =.054); and between CCS and M4CCE (r =.423, p =.009). Reli...Continue Reading

References

Nov 11, 1992·Annals of Internal Medicine·G L NoelJ Harvey
Sep 1, 1992·Journal of General Internal Medicine·J D CarlineP G Ramsey
May 1, 1989·Journal of General Internal Medicine·J E HerbersM J Weaver
Jan 1, 1984·Medical Education·P S LinksG R Norman
Jul 4, 1998·Annals of Internal Medicine·W LevinsonK Kroenke
Jul 8, 1998·Academic Medicine : Journal of the Association of American Medical Colleges·R J McAuley
Oct 31, 1998·Academic Medicine : Journal of the Association of American Medical Colleges·R W ChangK J Connell
Jan 12, 1999·Academic Medicine : Journal of the Association of American Medical Colleges·C D KreiterP Densen
Aug 3, 1999·Academic Medicine : Journal of the Association of American Medical Colleges·D G Kassebaum, R H Eaglen
Sep 21, 2000·Academic Medicine : Journal of the Association of American Medical Colleges·W Levinson, A Rubenstein
Oct 13, 2001·Academic Medicine : Journal of the Association of American Medical Colleges·M HasnainJ M Sinacore
Sep 4, 2003·JAMA : the Journal of the American Medical Association·Bruce E LandonJennifer Daley
Sep 26, 2003·Medical Education·Susan M Downing
Nov 13, 2003·Teaching and Learning in Medicine·Reed G WilliamsWilliam C McGaghie
Dec 24, 2003·Academic Medicine : Journal of the Association of American Medical Colleges·Eric S Holmboe
Jun 11, 2004·Medical Education·Memoona HasnainArthur S Elstein

❮ Previous
Next ❯

Citations

Jun 24, 2010·Advances in Health Sciences Education : Theory and Practice·G C MarkeyA D Hill
Oct 12, 2013·Teaching and Learning in Medicine·Gary S FerenchickAsad Mohmand
May 18, 2006·Journal of General Internal Medicine·Jennifer R Kogan, Karen E Hauer
Apr 22, 2006·Teaching and Learning in Medicine·Andrew R PulitoRobert M Mentzer
Mar 1, 2010·Journal of Graduate Medical Education·Joseph Gigante, Rebecca Swan
Apr 16, 2014·BMC Medical Education·Noelle Junod PerronDiana Dolmans
Jun 1, 2013·Korean journal of medical education·Sun Jung MyungJwa Seop Shin
Jul 31, 2009·The Mount Sinai Journal of Medicine, New York·H Barrett FrommeSteven M Downing
Aug 23, 2011·Medical Teacher·Tzu-Chieh YuAndrew G Hill
Nov 12, 2016·Medical Education Online·Noëlle Junod PerronMathieu Nendaz
Aug 26, 2009·Academic Medicine : Journal of the Association of American Medical Colleges·Varun SaxenaKaren E Hauer
Mar 5, 2020·Medical Teacher·Nadia M BajwaNoëlle Junod Perron
Sep 29, 2017·Perspectives on Medical Education·Jennifer R KoganEric Holmboe
Nov 17, 2016·BMC Medical Education·Noelle Junod PerronMathieu Nendaz
Oct 24, 2020·Perspectives on Medical Education·Norah DugganStephen Pennell
Jul 10, 2021·Teaching and Learning in Medicine·Margaret SwanbergLauren Maggio

❮ Previous
Next ❯

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.