Weaknesses of goodness-of-fit tests for evaluating propensity score models: the case of the omitted confounder

Pharmacoepidemiology and Drug Safety
Sherry WeitzenVincent Mor

Abstract

Propensity scores are used in observational studies to adjust for confounding, although they do not provide control for confounders omitted from the propensity score model. We sought to determine if tests used to evaluate logistic model fit and discrimination would be helpful in detecting the omission of an important confounder in the propensity score. Using simulated data, we estimated propensity scores under two scenarios: (1) including all confounders and (2) omitting the binary confounder. We compared the propensity score model fit and discrimination under each scenario, using the Hosmer-Lemeshow goodness-of-fit (GOF) test and the c-statistic. We measured residual confounding in treatment effect estimates adjusted by the propensity score omitting the confounder. The GOF statistic and discrimination of propensity score models were the same for models excluding an important predictor of treatment compared to the full propensity score model. The GOF test failed to detect poor model fit for the propensity score model omitting the confounder. C-statistics under both scenarios were similar. Residual confounding was observed from using the propensity score excluding the confounder (range: 1-30%). Omission of important confounders ...Continue Reading

References

Dec 1, 1991·American Journal of Public Health·D W HosmerS Lemeshow
Aug 1, 1991·Statistics in Medicine·M E MillerW M Tierney
Mar 1, 1989·American Journal of Public Health·S Greenland
Apr 1, 1984·Statistics in Medicine·F E HarrellR A Rosati
Sep 18, 1996·JAMA : the Journal of the American Medical Association·A F ConnorsW A Knaus
May 15, 1997·Statistics in Medicine·D W HosmerS Lemeshow
Feb 12, 1998·Annals of Internal Medicine·D B Rubin
Aug 24, 1999·American Journal of Epidemiology·M M Joffe, P R Rosenbaum
Feb 24, 2001·Medical Decision Making : an International Journal of the Society for Medical Decision Making·E W SteyerbergJ D Habbema
Feb 24, 2001·Journal of the American College of Cardiology·J P IoannidisC E Anagnostopoulos
Sep 18, 2001·JAMA : the Journal of the American Medical Association·M J Radford, J M Foody
Jan 5, 2002·Pharmacoepidemiology and Drug Safety·J Wang, P T Donnan
Jan 10, 2002·Statistics in Medicine·Erik Pulkstenis, Timothy J Robinson
Oct 16, 2002·Annals of Internal Medicine·Leonard E Braitman, Paul R Rosenbaum
Sep 24, 2004·Pharmacoepidemiology and Drug Safety·Sherry WeitzenVincent Mor

❮ Previous
Next ❯

Citations

Aug 7, 2010·Intensive Care Medicine·Etienne GayatRaphaël Porcher
Dec 22, 2005·Osteoporosis International : a Journal Established As Result of Cooperation Between the European Foundation for Osteoporosis and the National Osteoporosis Foundation of the USA·Y LuC C Glüer
May 13, 2008·Archives of Gynecology and Obstetrics·Maximilian B FranzFranz Kainer
Oct 25, 2007·Breast Cancer Research and Treatment·Mario SchootmanWilliam E Gillanders
Jun 14, 2008·The New England Journal of Medicine·Mark D Eisner
Mar 3, 2011·European Heart Journal·Georg Heinze, Peter Jüni
Jun 1, 2012·BMC Medical Research Methodology·Romain PirracchioSylvie Chevret
Jan 24, 2016·BMC Medical Research Methodology·Clémence LeyratBruno Giraudeau
May 28, 2011·Contemporary Clinical Trials·Giuseppe Biondi-ZoccaiMaria Grazia Modena
Apr 14, 2006·Basic & Clinical Pharmacology & Toxicology·Robert J GlynnTil Stürmer
Aug 2, 2011·Pharmacoepidemiology and Drug Safety·Svetlana V BelitserOlaf H Klungel
Feb 26, 2011·Pharmacoepidemiology and Drug Safety·Daniel WestreichTil Stürmer
Aug 14, 2012·Journal of Interventional Cardiology·Fabrizio D'AscenzoImad Sheiban
Mar 12, 2011·Pharmacoepidemiology and Drug Safety·Amanda R PatrickTil Stürmer
Sep 17, 2009·Pharmacoepidemiology and Drug Safety·Suzanne M CadaretteTil Stürmer
Aug 10, 2015·The American Journal of Cardiology·Christopher CaoTristan D Yan
Dec 18, 2014·American Journal of Epidemiology·Romain PirracchioMark van der Laan
Jan 26, 2011·Statistical Methods in Medical Research·Elizabeth WilliamsonJames Carpenter
Oct 11, 2017·American Journal of Epidemiology·Alexandra G EllisIssa J Dahabreh
Feb 8, 2008·Menopause : the Journal of the North American Menopause Society·Lubna PalSylvia Wassertheil-Smoller
Mar 24, 2020·Biometrical Journal. Biometrische Zeitschrift·Daniela ZöllerHarald Binder
Jan 20, 2006·American Journal of Epidemiology·Mario SchootmanDouglas K Miller
Jun 26, 2018·International Journal of Epidemiology·Yuxi TianMarc A Suchard
May 29, 2020·BMC Medical Research Methodology·Emily GrangerMark Lunt

❮ Previous
Next ❯

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.