Prognostic effect size of cardiovascular biomarkers in datasets from observational studies versus randomised trials: meta-epidemiology study - PubMed (original) (raw)
Review
Prognostic effect size of cardiovascular biomarkers in datasets from observational studies versus randomised trials: meta-epidemiology study
Ioanna Tzoulaki et al. BMJ. 2011.
Abstract
Objective: To compare the reported effect sizes of cardiovascular biomarkers in datasets from observational studies with those in datasets from randomised controlled trials.
Design: Review of meta-analyses.
Study selection: Meta-analyses of emerging cardiovascular biomarkers (not part of the Framingham risk score) that included datasets from at least one observational study and at least one randomised controlled trial were identified through Medline (last update, January 2011).
Data extraction: Study-specific risk ratios were extracted from all identified meta-analyses and synthesised with random effects for (a) all studies, and (b) separately for observational and for randomised controlled trial populations for comparison.
Results: 31 eligible meta-analyses were identified. For seven major biomarkers (C reactive protein, non-HDL cholesterol, lipoprotein(a), post-load glucose, fibrinogen, B-type natriuretic peptide, and troponins), the prognostic effect was significantly stronger in datasets from observational studies than in datasets from randomised controlled trials. For five of the biomarkers the effect was less than half as strong in the randomised controlled trial datasets. Across all 31 meta-analyses, on average datasets from observational studies suggested larger prognostic effects than those from randomised controlled trials; from a random effects meta-analysis, the estimated average difference in the effect size was 24% (95% CI 7% to 40%) of the overall biomarker effect.
Conclusions: Cardiovascular biomarkers often have less promising results in the evidence derived from randomised controlled trials than from observational studies.
Conflict of interest statement
Competing interests: All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi\_disclosure.pdf (available on request from the corresponding author) and declare: no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years, no other relationships or activities that could appear to have influenced the submitted work.
Figures
Results from 31 eligible meta-analyses that examined biomarkers for cardiovascular risk and included data from at least one observational study and one randomised controlled trial: comparison of effect sizes in datasets from observational studies v those from randomised controlled trials populations
Comment in
- Why do the results of randomised and observational studies differ?
Vandenbroucke JP. Vandenbroucke JP. BMJ. 2011 Nov 7;343:d7020. doi: 10.1136/bmj.d7020. BMJ. 2011. PMID: 22065658 No abstract available.
Similar articles
- Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas.
Crider K, Williams J, Qi YP, Gutman J, Yeung L, Mai C, Finkelstain J, Mehta S, Pons-Duran C, Menéndez C, Moraleda C, Rogers L, Daniels K, Green P. Crider K, et al. Cochrane Database Syst Rev. 2022 Feb 1;2(2022):CD014217. doi: 10.1002/14651858.CD014217. Cochrane Database Syst Rev. 2022. PMID: 36321557 Free PMC article. - Overview of the epidemiology methods and applications: strengths and limitations of observational study designs.
Colditz GA. Colditz GA. Crit Rev Food Sci Nutr. 2010;50 Suppl 1(s1):10-2. doi: 10.1080/10408398.2010.526838. Crit Rev Food Sci Nutr. 2010. PMID: 21132580 Free PMC article. - Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials.
Anglemyer A, Horvath HT, Bero L. Anglemyer A, et al. Cochrane Database Syst Rev. 2014 Apr 29;2014(4):MR000034. doi: 10.1002/14651858.MR000034.pub2. Cochrane Database Syst Rev. 2014. PMID: 24782322 Free PMC article. Updated. Review. - Mammographic density, endocrine therapy and breast cancer risk: a prognostic and predictive biomarker review.
Atakpa EC, Thorat MA, Cuzick J, Brentnall AR. Atakpa EC, et al. Cochrane Database Syst Rev. 2021 Oct 26;10(10):CD013091. doi: 10.1002/14651858.CD013091.pub2. Cochrane Database Syst Rev. 2021. PMID: 34697802 Free PMC article. Review. - Deviation from intention to treat analysis in randomised trials and treatment effect estimates: meta-epidemiological study.
Abraha I, Cherubini A, Cozzolino F, De Florio R, Luchetta ML, Rimland JM, Folletti I, Marchesi M, Germani A, Orso M, Eusebi P, Montedori A. Abraha I, et al. BMJ. 2015 May 27;350:h2445. doi: 10.1136/bmj.h2445. BMJ. 2015. PMID: 26016488 Free PMC article.
Cited by
- Global assessment of C-reactive protein and health-related outcomes: an umbrella review of evidence from observational studies and Mendelian randomization studies.
Markozannes G, Koutsioumpa C, Cividini S, Monori G, Tsilidis KK, Kretsavos N, Theodoratou E, Gill D, Ioannidis JP, Tzoulaki I. Markozannes G, et al. Eur J Epidemiol. 2021 Jan;36(1):11-36. doi: 10.1007/s10654-020-00681-w. Epub 2020 Sep 25. Eur J Epidemiol. 2021. PMID: 32978716 Free PMC article. - Trial-level characteristics associate with treatment effect estimates: a systematic review of meta-epidemiological studies.
Wang H, Song J, Lin Y, Dai W, Gao Y, Qin L, Chen Y, Tam W, Wu IX, Chung VC. Wang H, et al. BMC Med Res Methodol. 2022 Jun 15;22(1):171. doi: 10.1186/s12874-022-01650-5. BMC Med Res Methodol. 2022. PMID: 35705904 Free PMC article. - The expanding role of biomarkers in the assessment of smoking-related parenchymal lung diseases.
Doyle TJ, Pinto-Plata V, Morse D, Celli BR, Rosas IO. Doyle TJ, et al. Chest. 2012 Oct;142(4):1027-1034. doi: 10.1378/chest.12-1540. Chest. 2012. PMID: 23032451 Free PMC article. Review. - Meta-epidemiology.
Bae JM. Bae JM. Epidemiol Health. 2014 Sep 25;36:e2014019. doi: 10.4178/epih/e2014019. eCollection 2014. Epidemiol Health. 2014. PMID: 25266419 Free PMC article. - Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials: a meta-epidemiological study.
Toews I, Anglemyer A, Nyirenda JL, Alsaid D, Balduzzi S, Grummich K, Schwingshackl L, Bero L. Toews I, et al. Cochrane Database Syst Rev. 2024 Jan 4;1(1):MR000034. doi: 10.1002/14651858.MR000034.pub3. Cochrane Database Syst Rev. 2024. PMID: 38174786 Free PMC article.
References
- Hackam DG, Anand SS. Emerging risk factors for atherosclerotic vascular disease: a critical review of the evidence. JAMA 2003;290:932-40. - PubMed
- Tzoulaki I, Liberopoulos G, Ioannidis JP. Assessment of claims of improved prediction beyond the Framingham risk score. JAMA 2009;302:2345-52. - PubMed
- Tzoulaki I, Liberopoulos G, Ioannidis JP. Use of reclassification for assessment of improved prediction: an empirical evaluation. Int J Epidemiol 2011;40:1094-105. - PubMed
- Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR. Publication bias in clinical research. Lancet 1991;337:867-72. - PubMed
Publication types
MeSH terms
Substances
LinkOut - more resources
Full Text Sources
Other Literature Sources
Research Materials