The MISTELS program to measure technical skill in laparoscopic surgery : evidence for reliability

Surgical Endoscopy
Melina C VassiliouG M Fried

Abstract

The McGill Inanimate System for Training and Evaluation of Laparoscopic Skills (MISTELS) is a series of five tasks with an objective scoring system. The purpose of this study was to estimate the interrater and test-retest reliability of the MISTELS metrics and to assess their internal consistency. To determine interrater reliability, two trained observers scored 10 subjects, either live or on tape. Test-retest reliability was assessed by having 12 subjects perform two tests, the second immediately following the first. Interrater and test-retest reliability were assessed using intraclass correlation coefficients. Internal consistency between tasks was estimated using Cronbach's alpha. The interrater and test-retest reliabilities for the total scores were both excellent at 0.998 [95% confidence interval (CI), 0.985-1.00] and 0.892 (95% CI, 0.665-0.968), respectively. Cronbach's alpha for the first assessment of the test-retest was 0.86. The MISTELS metrics have excellent reliability, which exceeds the threshold level of 0.8 required for high-stakes evaluations. These findings support the use of MISTELS for evaluation in many different settings, including residency training programs.

References

Feb 1, 1997·Archives of Surgery·J C RosserR S Savalgi
Feb 22, 1997·BMJ : British Medical Journal·J M Bland, D G Altman
Mar 1, 1997·American Journal of Surgery·R ReznickW McCulloch
Jun 20, 1998·Surgical Endoscopy·G B HannaA Cuschieri
Jun 30, 1998·American Journal of Surgery·A M DerossisJ L Meakins
Aug 26, 1998·Surgical Endoscopy·A M DerossisG M Fried

❮ Previous
Next ❯

Citations

Aug 25, 2010·Surgical Endoscopy·Nicoleta O KolozsvariLiane S Feldman
Oct 12, 2012·Surgical Endoscopy·Esther M BonrathEmile Rijcken
Feb 26, 2013·Surgical Endoscopy·Esther M BonrathTeodor P Grantcharov
Aug 12, 2010·International Journal of Computer Assisted Radiology and Surgery·J B PagadorF M Sánchez-Margallo
Oct 24, 2007·Journal of Gastrointestinal Surgery : Official Journal of the Society for Surgery of the Alimentary Tract·Gerald M Fried
Dec 25, 2003·Surgery·Liane S FeldmanGerald M Fried
Aug 16, 2012·Journal of Endourology·Mohamed Abo El-EnenMohamed Rasheed
Dec 8, 2011·Journal of Laparoendoscopic & Advanced Surgical Techniques. Part a·Pieter J van EmpelWilhelmus J Meijerink
Aug 24, 2013·Journal of Laparoendoscopic & Advanced Surgical Techniques. Part a·Iain A M Hennessey, Peter Hewett
Nov 8, 2013·Journal of Laparoendoscopic & Advanced Surgical Techniques. Part a·Brady W KingMichael D Klein
Sep 2, 2009·British Journal of Anaesthesia·M D BouldV N Naik
Feb 3, 2009·Plastic and Reconstructive Surgery·Joseph M RosenSarah E Greer
Aug 3, 2012·Journal of the American Veterinary Medical Association·Boel A FranssonMargaret E Bryan
Sep 10, 2011·JSLS : Journal of the Society of Laparoendoscopic Surgeons·Hye-Chun HurHope A Ricciotti
Nov 17, 2009·Surgical Endoscopy·Magdalena K ChmarraJenny Dankelman
Feb 13, 2014·Surgical Endoscopy·Tim HoremanFrank-Willem Jansen
Aug 16, 2014·Journal of Surgical Education·John RudderowJohn Ferrara
Jul 19, 2014·The Journal of Surgical Research·Ana Maria Matos-AzevedoFrancisco Miguel Sánchez-Margallo
Jun 15, 2007·World Journal of Surgery·Gerald M Fried, Liane S Feldman
Jan 6, 2009·World Journal of Surgery·Michael PellenStephen Attwood
Nov 26, 2015·Pediatric Surgery International·Gregory ShepherdHugh Grant
Sep 11, 2013·Journal of Surgical Education·Manisha MistryTimothy D Wilson
Nov 20, 2015·Surgical Endoscopy·Allan OkrainecE Matt Ritter
Sep 3, 2013·Minimally Invasive Therapy & Allied Technologies : MITAT : Official Journal of the Society for Minimally Invasive Therapy·Juan A Sánchez-MargalloEnrique J Gómez
Mar 26, 2015·Gastrointestinal Endoscopy·Ashley L Faulx, Caroline Soyka
May 28, 2011·Journal of Pediatric Surgery·Georges AzzieAllan Okrainec
Jun 7, 2014·Advances in Health Sciences Education : Theory and Practice·Yinin HuSara Rasmussen
May 19, 2016·Veterinary Surgery : VS·Jessica J KilkennyAmeet Singh
Nov 12, 2013·Journal of the American College of Surgeons·Boris ZevinTeodor P Grantcharov
Nov 13, 2010·Surgical Oncology·Melina C Vassiliou, Liane S Feldman
May 26, 2010·The Surgical Clinics of North America·Ian Choy, Allan Okrainec
May 5, 2007·The Journal of Surgical Research·Lillian S Kao, Eric J Thomas
Oct 12, 2016·Medical Image Analysis·A L P NunesM Walter

❮ Previous
Next ❯

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.