Misuse of baseline comparison tests and subgroup analyses in surgical trials - PubMed (original) (raw)
Comparative Study
Misuse of baseline comparison tests and subgroup analyses in surgical trials
Mohit Bhandari et al. Clin Orthop Relat Res. 2006 Jun.
Abstract
It is unclear whether the misuse of statistical tests that compare patients' baseline characteristics and subgroup analyses in randomized controlled trials can be extrapolated to the surgical literature. We did an observational study evaluating the current use of baseline comparability tests and subgroup analyses in surgical randomized controlled trials. Published surgical randomized controlled trials in four medical journals were identified. We also identified randomized controlled trials in the Journal of Bone and Joint Surgery (American and British volumes). We identified 72 randomized controlled trials, with a mean of 10 +/- 8 baseline variables. Of 166 significance tests, 17 (10%) were significant. Twenty-seven (38%) trials included 54 subgroup analyses with a minimum of one and maximum of 23 subgroup analyses per study. Inappropriate emphasis on subgroup analyses occurred frequently. Forty-nine (91%) analyses were performed post hoc without prior hypotheses. Investigators reported differences between subgroups in 31 (57%) of the analyses, all of which were featured in the summary or conclusion. These inferences may be misleading, making their application to clinical practice unwarranted.
Similar articles
- Subgroup analyses in therapeutic cardiovascular clinical trials: are most of them misleading?
Hernández AV, Boersma E, Murray GD, Habbema JD, Steyerberg EW. Hernández AV, et al. Am Heart J. 2006 Feb;151(2):257-64. doi: 10.1016/j.ahj.2005.04.020. Am Heart J. 2006. PMID: 16442886 - Subgroup analysis, covariate adjustment and baseline comparisons in clinical trial reporting: current practice and problems.
Pocock SJ, Assmann SE, Enos LE, Kasten LE. Pocock SJ, et al. Stat Med. 2002 Oct 15;21(19):2917-30. doi: 10.1002/sim.1296. Stat Med. 2002. PMID: 12325108 - Primer: the fallacy of subgroup analysis.
Guillemin F. Guillemin F. Nat Clin Pract Rheumatol. 2007 Jul;3(7):407-13. doi: 10.1038/ncprheum0528. Nat Clin Pract Rheumatol. 2007. PMID: 17599075 Review. - The risk of false-positive results in orthopaedic surgical trials.
Bhandari M, Whang W, Kuo JC, Devereaux PJ, Sprague S, Tornetta P 3rd. Bhandari M, et al. Clin Orthop Relat Res. 2003 Aug;(413):63-9. doi: 10.1097/01.blo.0000079320.41006.c9. Clin Orthop Relat Res. 2003. PMID: 12897597 - A substantial and confusing variation exists in handling of baseline covariates in randomized controlled trials: a review of trials published in leading medical journals.
Austin PC, Manca A, Zwarenstein M, Juurlink DN, Stanbrook MB. Austin PC, et al. J Clin Epidemiol. 2010 Feb;63(2):142-53. doi: 10.1016/j.jclinepi.2009.06.002. Epub 2009 Aug 27. J Clin Epidemiol. 2010. PMID: 19716262 Review.
Cited by
- Subgroup Analysis of Trials Is Rarely Easy (SATIRE): a study protocol for a systematic review to characterize the analysis, reporting, and claim of subgroup effects in randomized trials.
Sun X, Briel M, Busse JW, Akl EA, You JJ, Mejza F, Bala M, Diaz-Granados N, Bassler D, Mertz D, Srinathan SK, Vandvik PO, Malaga G, Alshurafa M, Dahm P, Alonso-Coello P, Heels-Ansdell DM, Bhatnagar N, Johnston BC, Wang L, Walter SD, Altman DG, Guyatt GH. Sun X, et al. Trials. 2009 Nov 9;10:101. doi: 10.1186/1745-6215-10-101. Trials. 2009. PMID: 19900273 Free PMC article. - Sex based subgroup differences in randomized controlled trials: empirical evidence from Cochrane meta-analyses.
Wallach JD, Sullivan PG, Trepanowski JF, Steyerberg EW, Ioannidis JP. Wallach JD, et al. BMJ. 2016 Nov 24;355:i5826. doi: 10.1136/bmj.i5826. BMJ. 2016. PMID: 27884869 Free PMC article. - CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials.
Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG. Moher D, et al. BMJ. 2010 Mar 23;340:c869. doi: 10.1136/bmj.c869. BMJ. 2010. PMID: 20332511 Free PMC article. No abstract available. - Reporting characteristics of non-primary publications of results of randomized trials: a cross-sectional review.
Hopewell S, Collins GS, Hirst A, Kirtley S, Tajar A, Gerry S, Altman DG. Hopewell S, et al. Trials. 2013 Jul 31;14:240. doi: 10.1186/1745-6215-14-240. Trials. 2013. PMID: 23902608 Free PMC article. Review. - Development of the Instrument to assess the Credibility of Effect Modification Analyses (ICEMAN) in randomized controlled trials and meta-analyses.
Schandelmaier S, Briel M, Varadhan R, Schmid CH, Devasenapathy N, Hayward RA, Gagnier J, Borenstein M, van der Heijden GJMG, Dahabreh IJ, Sun X, Sauerbrei W, Walsh M, Ioannidis JPA, Thabane L, Guyatt GH. Schandelmaier S, et al. CMAJ. 2020 Aug 10;192(32):E901-E906. doi: 10.1503/cmaj.200077. CMAJ. 2020. PMID: 32778601 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources