Incorporating variations in the quality of individual randomized trials into meta-analysis - PubMed (original) (raw)
Incorporating variations in the quality of individual randomized trials into meta-analysis
A S Detsky et al. J Clin Epidemiol. 1992 Mar.
Abstract
Meta-analysis is a method of synthesizing evidence from multiple sources. It has been increasingly applied to combine results from randomized trials of therapeutic strategies. Unfortunately there is often variation in the quality of the trials that are included in meta-analyses, limiting the value of combining the results in an overview. This variation in quality can lead to both bias and reduction in precision of the estimate of the therapy's effectiveness. There are a number of methods for quantifying the quality of trials including the detailed Chalmers system and simple scales. The nature of the relationship between these quality scores and the true estimate of effectiveness is unknown at this time. We discuss four methods of incorporating quality into meta-analysis: threshold score as inclusion/exclusion criterion, use of quality score as a weight in statistical pooling, visual plot of effect size against quality score and sequential combination of trial results based on quality score. The last method permits an examination of the relation between quality and both bias and precision on the pooled estimates. We conclude that while it is possible to incorporate the effect of variation of quality of individual trials into overviews, this issue requires more study.
Similar articles
- Assessing the impact of attrition in randomized controlled trials.
Hewitt CE, Kumaravel B, Dumville JC, Torgerson DJ; Trial attrition study group. Hewitt CE, et al. J Clin Epidemiol. 2010 Nov;63(11):1264-70. doi: 10.1016/j.jclinepi.2010.01.010. Epub 2010 Jun 22. J Clin Epidemiol. 2010. PMID: 20573482 - Low-Dose Aspirin for the Prevention of Morbidity and Mortality From Preeclampsia: A Systematic Evidence Review for the U.S. Preventive Services Task Force [Internet].
Henderson JT, Whitlock EP, O'Conner E, Senger CA, Thompson JH, Rowland MG. Henderson JT, et al. Rockville (MD): Agency for Healthcare Research and Quality (US); 2014 Apr. Report No.: 14-05207-EF-1. Rockville (MD): Agency for Healthcare Research and Quality (US); 2014 Apr. Report No.: 14-05207-EF-1. PMID: 24783270 Free Books & Documents. Review. - Sutureless Aortic Valve Replacement for Treatment of Severe Aortic Stenosis: A Single Technology Assessment of Perceval Sutureless Aortic Valve [Internet].
Desser AS, Arentz-Hansen H, Fagerlund BF, Harboe I, Lauvrak V. Desser AS, et al. Oslo, Norway: Knowledge Centre for the Health Services at The Norwegian Institute of Public Health (NIPH); 2017 Aug 25. Report from the Norwegian Institute of Public Health No. 2017-01. Oslo, Norway: Knowledge Centre for the Health Services at The Norwegian Institute of Public Health (NIPH); 2017 Aug 25. Report from the Norwegian Institute of Public Health No. 2017-01. PMID: 29553663 Free Books & Documents. Review. - Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses?
Moher D, Pham B, Jones A, Cook DJ, Jadad AR, Moher M, Tugwell P, Klassen TP. Moher D, et al. Lancet. 1998 Aug 22;352(9128):609-13. doi: 10.1016/S0140-6736(98)01085-X. Lancet. 1998. PMID: 9746022 - Single-center trials show larger treatment effects than multicenter trials: evidence from a meta-epidemiologic study.
Dechartres A, Boutron I, Trinquart L, Charles P, Ravaud P. Dechartres A, et al. Ann Intern Med. 2011 Jul 5;155(1):39-51. doi: 10.7326/0003-4819-155-1-201107050-00006. Ann Intern Med. 2011. PMID: 21727292
Cited by
- Short Course Radiation in the Treatment of Localized Rectal Cancer: A Systematic Review and Meta-Analysis.
Chen C, Sun P, Rong J, Weng HW, Dai QS, Ye S. Chen C, et al. Sci Rep. 2015 Jun 9;5:10953. doi: 10.1038/srep10953. Sci Rep. 2015. PMID: 26055266 Free PMC article. - Follow-up of patients with curatively resected colorectal cancer: a practice guideline.
Figueredo A, Rumble RB, Maroun J, Earle CC, Cummings B, McLeod R, Zuraw L, Zwaal C; Gastrointestinal Cancer Disease Site Group of Cancer Care Ontario's Program in Evidence-based Care. Figueredo A, et al. BMC Cancer. 2003 Oct 6;3:26. doi: 10.1186/1471-2407-3-26. BMC Cancer. 2003. PMID: 14529575 Free PMC article. Review. - Inconsistency in the items included in tools used in general health research and physical therapy to evaluate the methodological quality of randomized controlled trials: a descriptive analysis.
Armijo-Olivo S, Fuentes J, Ospina M, Saltaji H, Hartling L. Armijo-Olivo S, et al. BMC Med Res Methodol. 2013 Sep 17;13:116. doi: 10.1186/1471-2288-13-116. BMC Med Res Methodol. 2013. PMID: 24044807 Free PMC article. Review. - Sex-Specific Associations Between Alcohol Consumption and Incidence of Hypertension: A Systematic Review and Meta-Analysis of Cohort Studies.
Roerecke M, Tobe SW, Kaczorowski J, Bacon SL, Vafaei A, Hasan OSM, Krishnan RJ, Raifu AO, Rehm J. Roerecke M, et al. J Am Heart Assoc. 2018 Jun 27;7(13):e008202. doi: 10.1161/JAHA.117.008202. J Am Heart Assoc. 2018. PMID: 29950485 Free PMC article. - Effect of statins on pulmonary function in patients with chronic obstructive pulmonary disease: a systematic review and meta-analysis of randomized controlled trials.
Chen X, Hu F, Chai F, Chen X. Chen X, et al. J Thorac Dis. 2023 Jul 31;15(7):3944-3952. doi: 10.21037/jtd-23-1042. Epub 2023 Jul 27. J Thorac Dis. 2023. PMID: 37559605 Free PMC article.