Debate: Subgroup analyses in clinical trials: fun to look at - but don't believe them! - PubMed (original) (raw)

Debate: Subgroup analyses in clinical trials: fun to look at - but don't believe them!

Peter Sleight. Curr Control Trials Cardiovasc Med. 2000.

Abstract

Analysis of subgroup results in a clinical trial is surprisingly unreliable, even in a large trial. This is the result of a combination of reduced statistical power, increased variance and the play of chance. Reliance on such analyses is likely to be more erroneous, and hence harmful, than application of the overall proportional (or relative) result in the whole trial to the estimate of absolute risk in that subgroup. Plausible explanations can usually be found for effects that are, in reality, simply due to the play of chance. When clinicians believe such subgroup analyses, there is a real danger of harm to the individual patient.

PubMed Disclaimer

Similar articles

• Subgroup analyses in randomised controlled trials: quantifying the risks of false-positives and false-negatives.
  Brookes ST, Whitley E, Peters TJ, Mulheran PA, Egger M, Davey Smith G. Brookes ST, et al. Health Technol Assess. 2001;5(33):1-56. doi: 10.3310/hta5330. Health Technol Assess. 2001. PMID: 11701102 Review.
• DICE 2: a further investigation of the effects of chance in life, death and subgroup analyses.
  Clarke M, Halsey J. Clarke M, et al. Int J Clin Pract. 2001 May;55(4):240-2. Int J Clin Pract. 2001. PMID: 11406908
• Low-Dose Aspirin for the Prevention of Morbidity and Mortality From Preeclampsia: A Systematic Evidence Review for the U.S. Preventive Services Task Force [Internet].
  Henderson JT, Whitlock EP, O'Conner E, Senger CA, Thompson JH, Rowland MG. Henderson JT, et al. Rockville (MD): Agency for Healthcare Research and Quality (US); 2014 Apr. Report No.: 14-05207-EF-1. Rockville (MD): Agency for Healthcare Research and Quality (US); 2014 Apr. Report No.: 14-05207-EF-1. PMID: 24783270 Free Books & Documents. Review.
• Estimates of subgroup treatment effects in overall nonsignificant trials: To what extent should we believe in them?
  Tanniou J, van der Tweel I, Teerenstra S, Roes KCB. Tanniou J, et al. Pharm Stat. 2017 Jul;16(4):280-295. doi: 10.1002/pst.1810. Epub 2017 May 15. Pharm Stat. 2017. PMID: 28503861
• Challenges of subgroup analyses in multinational clinical trials: experiences from the MERIT-HF trial.
  Wedel H, Demets D, Deedwania P, Fagerberg B, Goldstein S, Gottlieb S, Hjalmarson A, Kjekshus J, Waagstein F, Wikstrand J; MERIT-HF Study Group. Wedel H, et al. Am Heart J. 2001 Sep;142(3):502-11. doi: 10.1067/mhj.2001.117600. Am Heart J. 2001. PMID: 11526365 Clinical Trial.

Cited by

• Maternal education preferences moderate the effects of mandatory employment and education programs on child positive and problem behaviors.
  Gassman-Pines A, Godfrey EB, Yoshikawa H. Gassman-Pines A, et al. Child Dev. 2013 Jan-Feb;84(1):198-208. doi: 10.1111/j.1467-8624.2012.01832.x. Epub 2012 Aug 3. Child Dev. 2013. PMID: 22861169 Free PMC article.
• Quantifying App Store Dynamics: Longitudinal Tracking of Mental Health Apps.
  Larsen ME, Nicholas J, Christensen H. Larsen ME, et al. JMIR Mhealth Uhealth. 2016 Aug 9;4(3):e96. doi: 10.2196/mhealth.6020. JMIR Mhealth Uhealth. 2016. PMID: 27507641 Free PMC article.
• Assessment of effect modification of statins on new-onset diabetes based on various medical backgrounds: a retrospective cohort study.
  Yamazaki K, Takahashi Y, Teduka K, Nakayama T, Nishida Y, Asai S. Yamazaki K, et al. BMC Pharmacol Toxicol. 2019 May 28;20(1):34. doi: 10.1186/s40360-019-0314-x. BMC Pharmacol Toxicol. 2019. PMID: 31138326 Free PMC article.
• WHO guidelines on fluid resuscitation in children: missing the FEAST data.
  Kiguli S, Akech SO, Mtove G, Opoka RO, Engoru C, Olupot-Olupot P, Nyeko R, Evans J, Crawley J, Prevatt N, Reyburn H, Levin M, George EC, South A, Babiker AG, Gibb DM, Maitland K. Kiguli S, et al. BMJ. 2014 Jan 14;348:f7003. doi: 10.1136/bmj.f7003. BMJ. 2014. PMID: 24423891 Free PMC article. No abstract available.
• Stress Echocardiography Positivity Predicts Cancer Death.
  Carpeggiani C, Landi P, Michelassi C, Andreassi MG, Sicari R, Picano E. Carpeggiani C, et al. J Am Heart Assoc. 2017 Dec 12;6(12):e007104. doi: 10.1161/JAHA.117.007104. J Am Heart Assoc. 2017. PMID: 29233827 Free PMC article.

References

1. 1. Collins R, Peto R, Gray R, Parish S. Large-scale randomized evidence: trials and overviews. Oxford Textbook of Medicine, edn 3. Edited by Weatherall DJ, Ledingham JGG, Warrell DA. Oxford, UK: Oxford University Press, 1996. pp. 21–32.
2. 1. Hansson L, Lindholm LH, Niskanen L, Lanke J, Hedner T, Niklason A, Luomanmaki K, Dahlof B, de Faire U, Morlin C, Karlberg BE, Wester PO, Bjorck JE. Effect of angiotensin-converting-enzyme inhibition compared with conventional therapy on cardiovascular morbidity and mortality in hypertension: the Captopril Prevention Project (CAPPP) randomised trial. . Lancet. 1999;353:611–616. doi: 10.1016/S0140-6736(98)05012-0. - DOI - PubMed
3. 1. ISIS-2 (Second International Study of Infarct Survival) Collaborative Group Randomised trial of intravenous streptokinase, oral aspirin, both or neither among 17,187 cases of suspected acute myocardial infarction: ISIS-2. Lancet. 1988;ii:349–360. - PubMed
4. 1. The Heart Outcomes Prevention Evaluation Study Investigators Effects of an angiotensin-converting enzyme inhibitor, ramipril, on death from cardiovascular causes, myocardial infarction, and stroke in high-risk patients. N Engl J Med. 2000;342:145–153. doi: 10.1056/NEJM200001203420301. - DOI - PubMed
5. 1. Fibrinolytic Therapy Trialists' (FTT) Collaborative Group Indications for fibrinolytic therapy in suspected acute myocardial infarction: collaborative overview of mortality and major morbidity results from all randomised trials of more than 1000 patients. Lancet . 1994;343:311–322. doi: 10.1016/S0140-6736(94)91161-4. - DOI - PubMed

LinkOut - more resources

• Full Text Sources

  • BioMed Central
  • Europe PubMed Central
  • PubMed Central