Balance diagnostics for comparing the distribution of baseline covariates between treatment groups in propensity-score matched samples - PubMed (original) (raw)
. 2009 Nov 10;28(25):3083-107.
doi: 10.1002/sim.3697.
Affiliations
- PMID: 19757444
- PMCID: PMC3472075
- DOI: 10.1002/sim.3697
Free PMC article
Balance diagnostics for comparing the distribution of baseline covariates between treatment groups in propensity-score matched samples
Peter C Austin. Stat Med. 2009.
Free PMC article
Abstract
The propensity score is a subject's probability of treatment, conditional on observed baseline covariates. Conditional on the true propensity score, treated and untreated subjects have similar distributions of observed baseline covariates. Propensity-score matching is a popular method of using the propensity score in the medical literature. Using this approach, matched sets of treated and untreated subjects with similar values of the propensity score are formed. Inferences about treatment effect made using propensity-score matching are valid only if, in the matched sample, treated and untreated subjects have similar distributions of measured baseline covariates. In this paper we discuss the following methods for assessing whether the propensity score model has been correctly specified: comparing means and prevalences of baseline characteristics using standardized differences; ratios comparing the variance of continuous covariates between treated and untreated subjects; comparison of higher order moments and interactions; five-number summaries; and graphical methods such as quantile-quantile plots, side-by-side boxplots, and non-parametric density plots for comparing the distribution of baseline covariates between treatment groups. We describe methods to determine the sampling distribution of the standardized difference when the true standardized difference is equal to zero, thereby allowing one to determine the range of standardized differences that are plausible with the propensity score model having been correctly specified. We highlight the limitations of some previously used methods for assessing the adequacy of the specification of the propensity-score model. In particular, methods based on comparing the distribution of the estimated propensity score between treated and untreated subjects are uninformative.
Figures
Figure 1
Absolute standardized differences for baseline covariates comparing treated to untreated subjects in the original and the matched sample.
Figure 2
Relationship between sample size and the standard deviation of empirical sampling distribution of standardized difference.
Figure 3
Side-by-side boxplots and Q–Q plots for age.
Figure 4
Density plots and cumulative distribution functions for age.
Figure 5
Distribution of estimated propensity score in treated and untreated subjects in different matched samples.
Similar articles
- Assessing balance in measured baseline covariates when using many-to-one matching on the propensity-score.
Austin PC. Austin PC. Pharmacoepidemiol Drug Saf. 2008 Dec;17(12):1218-25. doi: 10.1002/pds.1674. Pharmacoepidemiol Drug Saf. 2008. PMID: 18972455 - Goodness-of-fit diagnostics for the propensity score model when estimating treatment effects using covariate adjustment with the propensity score.
Austin PC. Austin PC. Pharmacoepidemiol Drug Saf. 2008 Dec;17(12):1202-17. doi: 10.1002/pds.1673. Pharmacoepidemiol Drug Saf. 2008. PMID: 18972454 - The concept of the marginally matched subject in propensity-score matched analyses.
Austin PC, Lee DS. Austin PC, et al. Pharmacoepidemiol Drug Saf. 2009 Jun;18(6):469-82. doi: 10.1002/pds.1733. Pharmacoepidemiol Drug Saf. 2009. PMID: 19319923 - A critical appraisal of propensity-score matching in the medical literature between 1996 and 2003.
Austin PC. Austin PC. Stat Med. 2008 May 30;27(12):2037-49. doi: 10.1002/sim.3150. Stat Med. 2008. PMID: 18038446 Review.
Cited by
- Postoperative Use of Biologics was Less Common among Patients with Crohn's Disease With Emergent/Urgent Versus Elective Intestinal Resection.
Nguyen JT, Barnes EL, Thorpe CT, Stitzenberg KB, Tak CR, Kinlaw AC. Nguyen JT, et al. Gastro Hep Adv. 2022;1(5):894-904. doi: 10.1016/j.gastha.2022.06.003. Epub 2022 Jun 13. Gastro Hep Adv. 2022. PMID: 36091220 Free PMC article. - Evaluating the impact of long-term exposure to fine particulate matter on mortality among the elderly.
Wu X, Braun D, Schwartz J, Kioumourtzoglou MA, Dominici F. Wu X, et al. Sci Adv. 2020 Jul 17;6(29):eaba5692. doi: 10.1126/sciadv.aba5692. eCollection 2020 Jul. Sci Adv. 2020. PMID: 32832626 Free PMC article. - Angiography versus colonoscopy in patients with severe lower gastrointestinal bleeding: a nation-wide observational study.
Miyakuni Y, Nakajima M, Ohbe H, Sasabuchi Y, Kaszynski RH, Ishimaru M, Matsui H, Fushimi K, Yamaguchi Y, Yasunaga H. Miyakuni Y, et al. Acute Med Surg. 2020 Jun 30;7(1):e533. doi: 10.1002/ams2.533. eCollection 2020 Jan-Dec. Acute Med Surg. 2020. PMID: 32617165 Free PMC article. - Survival of Ventilated Extremely Premature Neonates With Severe Intraventricular Hemorrhage.
McCauley KE, Carey EC, Weaver AL, Mara KC, Clark RH, Carey WA, Collura CA. McCauley KE, et al. Pediatrics. 2021 Apr;147(4):e20201584. doi: 10.1542/peds.2020-1584. Epub 2021 Mar 16. Pediatrics. 2021. PMID: 33727247 Free PMC article. - Lower risk of stroke after alcohol abstinence in patients with incident atrial fibrillation: a nationwide population-based cohort study.
Lee SR, Choi EK, Jung JH, Han KD, Oh S, Lip GYH. Lee SR, et al. Eur Heart J. 2021 Dec 7;42(46):4759-4768. doi: 10.1093/eurheartj/ehab315. Eur Heart J. 2021. PMID: 34097040 Free PMC article.
References
- Rosenbaum PR, Rubin DB. The central role of the propensity score in observational studies for causal effects. Biometrika. 1983;70:41–55.
- Rosenbaum PR, Rubin DB. Reducing bias in observational studies using subclassification on the propensity score. Journal of the American Statistical Association. 1984;79:516–524.
- Austin PC, Mamdani MM. A comparison of propensity score methods: a case-study estimating the effectiveness of post-AMI statin use. Statistics in Medicine. 2006;25:2084–2106. - PubMed
- Weitzen S, Lapane KL, Toledano AY, Hume AL, Mor V. Principles for modeling propensity scores in medical research: a systematic literature review. Pharmacoepidemiology and Drug Safety. 2004;13:841–853. - PubMed
- Shah BR, Laupacis A, Hux JE, Austin PC. Propensity score methods give similar results to traditional regression modeling in observational studies: a systematic review. Journal of Clinical Epidemiology. 2005;58:550–559. - PubMed
Publication types
MeSH terms
Substances
LinkOut - more resources
Full Text Sources
Other Literature Sources