Abstract
Malfunctions in Clinical Decision Support (CDS) systems occur due to a multitude of reasons, and often go unnoticed, leading to potentially poor outcomes. Our goal was to identify malfunctions within CDS systems. We evaluated 6 anomaly detection models: (1) Poisson Changepoint Model, (2) Autoregressive Integrated Moving Average (ARIMA) Model, (3) Hierarchical Divisive Changepoint (HDC) Model, (4) Bayesian Changepoint Model, (5) Seasonal Hybrid Extreme Studentized Deviate (SHESD) Model, and (6) E-Divisive with Median (EDM) Model and characterized their ability to find known anomalies. We analyzed 4 CDS alerts with known malfunctions from the Longitudinal Medical Record (LMR) and Epic® (Epic Systems Corporation, Madison, WI, USA) at Brigham and Women's Hospital, Boston, MA. The 4 rules recommend lead testing in children, aspirin therapy in patients with coronary artery disease, pneumococcal vaccination in immunocompromised adults and thyroid testing in patients taking amiodarone. Poisson changepoint, ARIMA, HDC, Bayesian changepoint and the SHESD model were able to detect anomalies in an alert for lead screening in children and in an alert for pneumococcal conjugate vaccine in immunocompromised adults. EDM was able to detect anom...Continue Reading
References
Apr 22, 1983·European Journal of Pharmacology·A A BorbélyD Lehmann
Mar 10, 2005·JAMA : the Journal of the American Medical Association·Amit X GargR Brian Haynes
Mar 16, 2005·BMJ : British Medical Journal·Kensaku KawamotoDavid F Lobach
Jan 11, 2007·Journal of the American Medical Informatics Association : JAMIA·Jerome A OsheroffDon E Detmer
Apr 7, 2010·Journal of Evaluation in Clinical Practice·Rebecca J ShackeltonJohn B McKinlay
Jul 22, 2010·The New England Journal of Medicine·David Blumenthal, Marilyn Tavenner
Aug 19, 2011·Journal of the American Medical Informatics Association : JAMIA·Allison B McCoyJosh F Peterson
Jul 4, 2012·Annals of Internal Medicine·Tiffani J BrightDavid Lobach
Mar 16, 2013·Journal of the American Medical Informatics Association : JAMIA·Adam B LandmanEric G Poon
Aug 21, 2013·Journal of Internal Medicine·P CoorevitsD Kalra
Oct 10, 2014·Applied Clinical Informatics·G ZuccottiA Wright
May 31, 2015·Proceedings of the National Academy of Sciences of the United States of America·Zhou FanDavid E Shaw
Mar 31, 2016·Journal of the American Medical Informatics Association : JAMIA·Adam WrightDavid W Bates
Oct 11, 2016·Journal of Biomedical Informatics·Milos HauskrechtGilles Clermont
Sep 8, 2017·Applied Clinical Informatics·Steven Z KassakianDavid A Dorr
Citations
Dec 13, 2018·Health Informatics Journal·Dean F SittigHardeep Singh
May 18, 2020·Medical Physics·Geetha MahadevaiahLeonard Wee
Jul 31, 2018·Journal of the American Medical Informatics Association : JAMIA·Adam WrightDean F Sittig
Jul 25, 2019·BMC Medical Informatics and Decision Making·Hossein EstiriShawn N Murphy
Sep 13, 2019·Journal of the American Medical Informatics Association : JAMIA·Vaishnavi KannanSeth M Toomay
Dec 17, 2019·Health Systems·Olufemi A OmitaomuJonathan R Nebeker
Nov 10, 2020·Journal of the American Medical Informatics Association : JAMIA·Amol A VermaFahad Razak
Dec 7, 2021·Clinical Chemistry·Andrew E O Hughes, Ronald Jackups
Jan 14, 2022·Journal of the American Medical Informatics Association : JAMIA·Dean F SittigHardeep Singh
Nov 7, 2019··Periklis A. PapakonstantinouHafiz Asif