Funnel plots for detecting bias in meta-analysis: guidelines on choice of axis - PubMed (original) (raw)
Funnel plots for detecting bias in meta-analysis: guidelines on choice of axis
J A Sterne et al. J Clin Epidemiol. 2001 Oct.
Abstract
Asymmetry in funnel plots may indicate publication bias in meta-analysis, but the shape of the plot in the absence of bias depends on the choice of axes. We evaluated standard error, precision (inverse of standard error), variance, inverse of variance, sample size and log sample size (vertical axis) and log odds ratio, log risk ratio and risk difference (horizontal axis). Standard error is likely to be the best choice for the vertical axis: the expected shape in the absence of bias corresponds to a symmetrical funnel, straight lines to indicate 95% confidence intervals can be included and the plot emphasises smaller studies which are more prone to bias. Precision or inverse of variance is useful when comparing meta-analyses of small trials with subsequent large trials. The use of sample size or log sample size is problematic because the expected shape of the plot in the absence of bias is unpredictable. We found similar evidence for asymmetry and between trial variation in a sample of 78 published meta-analyses whether odds ratios or risk ratios were used on the horizontal axis. Different conclusions were reached for risk differences and this was related to increased between-trial variation. We conclude that funnel plots of meta-analyses should generally use standard error as the measure of study size and ratio measures of treatment effect.
Similar articles
- Detecting small-study effects and funnel plot asymmetry in meta-analysis of survival data: A comparison of new and existing tests.
Debray TPA, Moons KGM, Riley RD. Debray TPA, et al. Res Synth Methods. 2018 Mar;9(1):41-50. doi: 10.1002/jrsm.1266. Epub 2017 Nov 28. Res Synth Methods. 2018. PMID: 28975717 Free PMC article. - Misleading funnel plot for detection of bias in meta-analysis.
Tang JL, Liu JL. Tang JL, et al. J Clin Epidemiol. 2000 May;53(5):477-84. doi: 10.1016/s0895-4356(99)00204-8. J Clin Epidemiol. 2000. PMID: 10812319 - Graphical augmentations to sample-size-based funnel plot in meta-analysis.
Lin L. Lin L. Res Synth Methods. 2019 Sep;10(3):376-388. doi: 10.1002/jrsm.1340. Epub 2019 Feb 7. Res Synth Methods. 2019. PMID: 30664834 Free PMC article. - Publication bias in ecology and evolution: an empirical assessment using the 'trim and fill' method.
Jennions MD, Møller AP. Jennions MD, et al. Biol Rev Camb Philos Soc. 2002 May;77(2):211-22. doi: 10.1017/s1464793101005875. Biol Rev Camb Philos Soc. 2002. PMID: 12056747 Review. - Factors affecting the comparability of meta-analyses and largest trials results in perinatology.
Villar J, Piaggio G, Carroli G, Donner A. Villar J, et al. J Clin Epidemiol. 1997 Sep;50(9):997-1002. doi: 10.1016/s0895-4356(97)00148-0. J Clin Epidemiol. 1997. PMID: 9363033 Review.
Cited by
- Depressive and anxiety symptoms amid COVID-19 pandemic among healthcare workers in a low-resource setting: a systematic review and meta-analysis from Ethiopia.
Kassew T, Melkam M, Minichil W, Wondie M, Ali D. Kassew T, et al. Front Psychiatry. 2024 Oct 22;15:1342002. doi: 10.3389/fpsyt.2024.1342002. eCollection 2024. Front Psychiatry. 2024. PMID: 39502300 Free PMC article. - Mental health interventions affecting university faculty: a systematic review and meta-analysis.
Hammoudi Halat D, Sami W, Soltani A, Malki A. Hammoudi Halat D, et al. BMC Public Health. 2024 Nov 2;24(1):3040. doi: 10.1186/s12889-024-20402-2. BMC Public Health. 2024. PMID: 39488684 Free PMC article. - Meta-analysis of natural killer cell cytotoxicity in myalgic encephalomyelitis/chronic fatigue syndrome.
Baraniuk JN, Eaton-Fitch N, Marshall-Gradisnik S. Baraniuk JN, et al. Front Immunol. 2024 Oct 17;15:1440643. doi: 10.3389/fimmu.2024.1440643. eCollection 2024. Front Immunol. 2024. PMID: 39483457 Free PMC article.