The relation between treatment benefit and underlying risk in meta-analysis - PubMed (original) (raw)
Review
The relation between treatment benefit and underlying risk in meta-analysis
S J Sharp et al. BMJ. 1996.
Abstract
In meta-analyses of clinical trials comparing a treated group with a control group it has been common to ask whether the treatment benefit varies according to the underlying risk of the patients in the different trials, with the hope of defining which patients would benefit most and which least from medical interventions. The usual analysis used to investigate this issue, however, which uses the observed proportions of events in the control groups of the trials as a measure of the underlying risk, is flawed and produces seriously misleading results. This arises through a bias due to regression to the mean and will be particularly acute in meta-analyses which include some small trials or in which the variability in the true underlying risks across trials is small. Approaches which previously have been thought to be more appropriate are to substitute the average proportion of events in the control and treated groups as the measure of underlying risk or to plot the proportion of events in the treated group against that in the control group (L'Abbé plot). However, these are still subject to bias in most circumstances. Because of the potentially seriously flawed conclusions that can result from such analyses, they should be replaced either by statistically appropriate (but more complex) approaches or, preferably, by analyses which investigate the dependence of the treatment effect on measured baseline characteristics of the patients in each trial.
Comment in
- Relation between treatment benefit and underlying risk in meta-analysis. Standard of "label invariance" should not be abandoned.
Senn S. Senn S. BMJ. 1996 Dec 14;313(7071):1550-1. doi: 10.1136/bmj.313.7071.1550a. BMJ. 1996. PMID: 8978249 Free PMC article. No abstract available.
Similar articles
- Investigating underlying risk as a source of heterogeneity in meta-analysis.
Thompson SG, Smith TC, Sharp SJ. Thompson SG, et al. Stat Med. 1997 Dec 15;16(23):2741-58. doi: 10.1002/(sici)1097-0258(19971215)16:23<2741::aid-sim703>3.0.co;2-0. Stat Med. 1997. PMID: 9421873 - Analysing the relationship between treatment effect and underlying risk in meta-analysis: comparison and development of approaches.
Sharp SJ, Thompson SG. Sharp SJ, et al. Stat Med. 2000 Dec 15;19(23):3251-74. doi: 10.1002/1097-0258(20001215)19:23<3251::aid-sim625>3.0.co;2-2. Stat Med. 2000. PMID: 11113958 - Baseline risk as predictor of treatment benefit: three clinical meta-re-analyses.
Arends LR, Hoes AW, Lubsen J, Grobbee DE, Stijnen T. Arends LR, et al. Stat Med. 2000 Dec 30;19(24):3497-518. doi: 10.1002/1097-0258(20001230)19:24<3497::aid-sim830>3.0.co;2-h. Stat Med. 2000. PMID: 11122510 - Aspirin Use in Adults: Cancer, All-Cause Mortality, and Harms: A Systematic Evidence Review for the U.S. Preventive Services Task Force [Internet].
Whitlock EP, Williams SB, Burda BU, Feightner A, Beil T. Whitlock EP, et al. Rockville (MD): Agency for Healthcare Research and Quality (US); 2015 Sep. Report No.: 13-05193-EF-1. Rockville (MD): Agency for Healthcare Research and Quality (US); 2015 Sep. Report No.: 13-05193-EF-1. PMID: 26491756 Free Books & Documents. Review. - Behavioral and Pharmacotherapy Weight Loss Interventions to Prevent Obesity-Related Morbidity and Mortality in Adults: An Updated Systematic Review for the U.S. Preventive Services Task Force [Internet].
LeBlanc EL, Patnode CD, Webber EM, Redmond N, Rushkin M, O’Connor EA. LeBlanc EL, et al. Rockville (MD): Agency for Healthcare Research and Quality (US); 2018 Sep. Report No.: 18-05239-EF-1. Rockville (MD): Agency for Healthcare Research and Quality (US); 2018 Sep. Report No.: 18-05239-EF-1. PMID: 30354042 Free Books & Documents. Review.
Cited by
- Fraction of inspired oxygen during general anesthesia for non-cardiac surgery: Systematic review and meta-analysis.
Høybye M, Lind PC, Holmberg MJ, Bolther M, Jessen MK, Vallentin MF, Hansen FB, Holst JM, Magnussen A, Hansen NS, Johannsen CM, Enevoldsen J, Jensen TH, Roessler LL, Klitholm MP, Eggertsen MA, Caap P, Boye C, Dabrowski KM, Vormfenne L, Henriksen J, Karlsson M, Balleby IR, Rasmussen MS, Paelestik K, Granfeldt A, Andersen LW. Høybye M, et al. Acta Anaesthesiol Scand. 2022 Sep;66(8):923-933. doi: 10.1111/aas.14102. Epub 2022 Jun 23. Acta Anaesthesiol Scand. 2022. PMID: 35675085 Free PMC article. Review. - Goal-directed haemodynamic therapy during general anaesthesia for noncardiac surgery: a systematic review and meta-analysis.
Jessen MK, Vallentin MF, Holmberg MJ, Bolther M, Hansen FB, Holst JM, Magnussen A, Hansen NS, Johannsen CM, Enevoldsen J, Jensen TH, Roessler LL, Lind PC, Klitholm MP, Eggertsen MA, Caap P, Boye C, Dabrowski KM, Vormfenne L, Høybye M, Henriksen J, Karlsson CM, Balleby IR, Rasmussen MS, Pælestik K, Granfeldt A, Andersen LW. Jessen MK, et al. Br J Anaesth. 2022 Mar;128(3):416-433. doi: 10.1016/j.bja.2021.10.046. Epub 2021 Dec 13. Br J Anaesth. 2022. PMID: 34916049 Free PMC article. - Accounting for post-randomization variables in meta-analysis: A joint meta-regression approach.
Lian Q, Zhang J, Hodges JS, Chen Y, Chu H. Lian Q, et al. Biometrics. 2023 Mar;79(1):358-367. doi: 10.1111/biom.13573. Epub 2021 Nov 10. Biometrics. 2023. PMID: 34587296 Free PMC article. - Controversy and Debate: Questionable utility of the relative risk in clinical research: Paper 2: Is the Odds Ratio "portable" in meta-analysis? Time to consider bivariate generalized linear mixed model.
Xiao M, Chen Y, Cole SR, MacLehose RF, Richardson DB, Chu H. Xiao M, et al. J Clin Epidemiol. 2022 Feb;142:280-287. doi: 10.1016/j.jclinepi.2021.08.004. Epub 2021 Aug 9. J Clin Epidemiol. 2022. PMID: 34384876 Free PMC article. - Most published meta-regression analyses based on aggregate data suffer from methodological pitfalls: a meta-epidemiological study.
Geissbühler M, Hincapié CA, Aghlmandi S, Zwahlen M, Jüni P, da Costa BR. Geissbühler M, et al. BMC Med Res Methodol. 2021 Jun 15;21(1):123. doi: 10.1186/s12874-021-01310-0. BMC Med Res Methodol. 2021. PMID: 34130658 Free PMC article.
References
- Ann Intern Med. 1987 Aug;107(2):224-33 - PubMed
- BMJ. 1995 Nov 18;311(7016):1356-9 - PubMed
- Stat Med. 1988 Sep;7(9):915-27 - PubMed
- Stat Med. 1991 Jun;10(6):971-9; discussion 979-80 - PubMed
- Ann Intern Med. 1992 Jul 1;117(1):59-70 - PubMed
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Medical