Evaluation of old and new tests of heterogeneity in epidemiologic meta-analysis - PubMed (original) (raw)
Evaluation of old and new tests of heterogeneity in epidemiologic meta-analysis
B Takkouche et al. Am J Epidemiol. 1999.
Abstract
The identification of heterogeneity in effects between studies is a key issue in meta-analyses of observational studies, since it is critical for determining whether it is appropriate to pool the individual results into one summary measure. The result of a hypothesis test is often used as the decision criterion. In this paper, the authors use a large simulation study patterned from the key features of five published epidemiologic meta-analyses to investigate the type I error and statistical power of five previously proposed asymptotic homogeneity tests, a parametric bootstrap version of each of the tests, and tau2-bootstrap, a test proposed by the authors. The results show that the asymptotic DerSimonian and Laird Q statistic and the bootstrap versions of the other tests give the correct type I error under the null hypothesis but that all of the tests considered have low statistical power, especially when the number of studies included in the meta-analysis is small (<20). From the point of view of validity, power, and computational ease, the Q statistic is clearly the best choice. The authors found that the performance of all of the tests considered did not depend appreciably upon the value of the pooled odds ratio, both for size and for power. Because tests for heterogeneity will often be underpowered, random effects models can be used routinely, and heterogeneity can be quantified by means of R(I), the proportion of the total variance of the pooled effect measure due to between-study variance, and CV(B), the between-study coefficient of variation.
Similar articles
- Misunderstandings about Q and 'Cochran's Q test' in meta-analysis.
Hoaglin DC. Hoaglin DC. Stat Med. 2016 Feb 20;35(4):485-95. doi: 10.1002/sim.6632. Epub 2015 Aug 24. Stat Med. 2016. PMID: 26303773 - Extreme between-study homogeneity in meta-analyses could offer useful insights.
Ioannidis JP, Trikalinos TA, Zintzaras E. Ioannidis JP, et al. J Clin Epidemiol. 2006 Oct;59(10):1023-32. doi: 10.1016/j.jclinepi.2006.02.013. Epub 2006 Aug 7. J Clin Epidemiol. 2006. PMID: 16980141 - A simplification and implementation of random-effects meta-analyses based on the exact distribution of Cochran's Q.
Preuß M, Ziegler A. Preuß M, et al. Methods Inf Med. 2014;53(1):54-61. doi: 10.3414/ME13-01-0073. Epub 2013 Dec 9. Methods Inf Med. 2014. PMID: 24317521 - Behavioral and Pharmacotherapy Weight Loss Interventions to Prevent Obesity-Related Morbidity and Mortality in Adults: An Updated Systematic Review for the U.S. Preventive Services Task Force [Internet].
LeBlanc EL, Patnode CD, Webber EM, Redmond N, Rushkin M, O’Connor EA. LeBlanc EL, et al. Rockville (MD): Agency for Healthcare Research and Quality (US); 2018 Sep. Report No.: 18-05239-EF-1. Rockville (MD): Agency for Healthcare Research and Quality (US); 2018 Sep. Report No.: 18-05239-EF-1. PMID: 30354042 Free Books & Documents. Review. - Behavioral Counseling to Promote a Healthful Diet and Physical Activity for Cardiovascular Disease Prevention in Adults Without Known Cardiovascular Disease Risk Factors: Updated Systematic Review for the U.S. Preventive Services Task Force [Internet].
Patnode CD, Evans CV, Senger CA, Redmond N, Lin JS. Patnode CD, et al. Rockville (MD): Agency for Healthcare Research and Quality (US); 2017 Jul. Report No.: 15-05222-EF-1. Rockville (MD): Agency for Healthcare Research and Quality (US); 2017 Jul. Report No.: 15-05222-EF-1. PMID: 29364620 Free Books & Documents. Review.
Cited by
- Tocilizumab Reduces Depression Risk in Rheumatoid Arthritis Patients: A Systematic Review and Meta-Analysis.
Baghdadi LR. Baghdadi LR. Psychol Res Behav Manag. 2024 Oct 4;17:3419-3441. doi: 10.2147/PRBM.S482409. eCollection 2024. Psychol Res Behav Manag. 2024. PMID: 39381332 Free PMC article. Review. - Impact of sarcopenia on outcomes following lumbar spine surgery for degenerative disease: an updated systematic review and meta-analysis.
Chen MJ, Lo YS, Lin CY, Tseng C, Hsiao PH, Lai CY, Li LY, Chen HT. Chen MJ, et al. Eur Spine J. 2024 Sep;33(9):3369-3380. doi: 10.1007/s00586-024-08364-w. Epub 2024 Jun 21. Eur Spine J. 2024. PMID: 38907066 - Combined Endoscopic Cyclophotocoagulation and Phacoemulsification Versus Phacoemulsification Alone in the Glaucoma Treatment: A Systematic Review and Meta-Analysis.
Amaral DC, Louzada RN, Moreira PHS, de Oliveira LN, Yuati TT, Guedes J, Alves MR, Mora-Paez DJ, Monteiro MLR. Amaral DC, et al. Cureus. 2024 Mar 9;16(3):e55853. doi: 10.7759/cureus.55853. eCollection 2024 Mar. Cureus. 2024. PMID: 38590498 Free PMC article. Review. - Circulating biomarkers of oxidative stress in people with acne vulgaris: a systematic review and meta-analysis.
Su L, Wang F, Wang Y, Qin C, Yang X, Ye J. Su L, et al. Arch Dermatol Res. 2024 Mar 15;316(4):105. doi: 10.1007/s00403-024-02840-5. Arch Dermatol Res. 2024. PMID: 38489064 - Differences in Smoking Behavior by Nativity, Race/Ethnicity, and Education among Women Diagnosed with Breast Cancer.
Uong SP, Torres JM, Alexeeff SE, Morey BN, Caan BJ, Kushi LH, Kroenke CH. Uong SP, et al. Cancer Epidemiol Biomarkers Prev. 2024 May 1;33(5):694-702. doi: 10.1158/1055-9965.EPI-23-0386. Cancer Epidemiol Biomarkers Prev. 2024. PMID: 38345508
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources