Prognostic effect size of cardiovascular biomarkers in datasets from observational studies versus randomised trials: meta-epidemiology study - PubMed (original) (raw)
Review
Prognostic effect size of cardiovascular biomarkers in datasets from observational studies versus randomised trials: meta-epidemiology study
Ioanna Tzoulaki et al. BMJ. 2011.
Abstract
Objective: To compare the reported effect sizes of cardiovascular biomarkers in datasets from observational studies with those in datasets from randomised controlled trials.
Design: Review of meta-analyses.
Study selection: Meta-analyses of emerging cardiovascular biomarkers (not part of the Framingham risk score) that included datasets from at least one observational study and at least one randomised controlled trial were identified through Medline (last update, January 2011).
Data extraction: Study-specific risk ratios were extracted from all identified meta-analyses and synthesised with random effects for (a) all studies, and (b) separately for observational and for randomised controlled trial populations for comparison.
Results: 31 eligible meta-analyses were identified. For seven major biomarkers (C reactive protein, non-HDL cholesterol, lipoprotein(a), post-load glucose, fibrinogen, B-type natriuretic peptide, and troponins), the prognostic effect was significantly stronger in datasets from observational studies than in datasets from randomised controlled trials. For five of the biomarkers the effect was less than half as strong in the randomised controlled trial datasets. Across all 31 meta-analyses, on average datasets from observational studies suggested larger prognostic effects than those from randomised controlled trials; from a random effects meta-analysis, the estimated average difference in the effect size was 24% (95% CI 7% to 40%) of the overall biomarker effect.
Conclusions: Cardiovascular biomarkers often have less promising results in the evidence derived from randomised controlled trials than from observational studies.
Conflict of interest statement
Competing interests: All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi\_disclosure.pdf (available on request from the corresponding author) and declare: no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years, no other relationships or activities that could appear to have influenced the submitted work.
Figures
Results from 31 eligible meta-analyses that examined biomarkers for cardiovascular risk and included data from at least one observational study and one randomised controlled trial: comparison of effect sizes in datasets from observational studies v those from randomised controlled trials populations
Comment in
- Why do the results of randomised and observational studies differ?
Vandenbroucke JP. Vandenbroucke JP. BMJ. 2011 Nov 7;343:d7020. doi: 10.1136/bmj.d7020. BMJ. 2011. PMID: 22065658 No abstract available.
Similar articles
- Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials.
Anglemyer A, Horvath HT, Bero L. Anglemyer A, et al. Cochrane Database Syst Rev. 2014 Apr 29;2014(4):MR000034. doi: 10.1002/14651858.MR000034.pub2. Cochrane Database Syst Rev. 2014. PMID: 24782322 Free PMC article. Updated. Review. - Deviation from intention to treat analysis in randomised trials and treatment effect estimates: meta-epidemiological study.
Abraha I, Cherubini A, Cozzolino F, De Florio R, Luchetta ML, Rimland JM, Folletti I, Marchesi M, Germani A, Orso M, Eusebi P, Montedori A. Abraha I, et al. BMJ. 2015 May 27;350:h2445. doi: 10.1136/bmj.h2445. BMJ. 2015. PMID: 26016488 Free PMC article. - Incretin treatment and risk of pancreatitis in patients with type 2 diabetes mellitus: systematic review and meta-analysis of randomised and non-randomised studies.
Li L, Shen J, Bala MM, Busse JW, Ebrahim S, Vandvik PO, Rios LP, Malaga G, Wong E, Sohani Z, Guyatt GH, Sun X. Li L, et al. BMJ. 2014 Apr 15;348:g2366. doi: 10.1136/bmj.g2366. BMJ. 2014. PMID: 24736555 Free PMC article. Review. - Meta-analyses of adverse effects data derived from randomised controlled trials as compared to observational studies: methodological overview.
Golder S, Loke YK, Bland M. Golder S, et al. PLoS Med. 2011 May;8(5):e1001026. doi: 10.1371/journal.pmed.1001026. Epub 2011 May 3. PLoS Med. 2011. PMID: 21559325 Free PMC article. Review. - Mediterranean-style diet for the primary and secondary prevention of cardiovascular disease.
Rees K, Takeda A, Martin N, Ellis L, Wijesekara D, Vepa A, Das A, Hartley L, Stranges S. Rees K, et al. Cochrane Database Syst Rev. 2019 Mar 13;3(3):CD009825. doi: 10.1002/14651858.CD009825.pub3. Cochrane Database Syst Rev. 2019. PMID: 30864165 Free PMC article.
Cited by
- Predicting outcomes in radiation oncology--multifactorial decision support systems.
Lambin P, van Stiphout RG, Starmans MH, Rios-Velazquez E, Nalbantov G, Aerts HJ, Roelofs E, van Elmpt W, Boutros PC, Granone P, Valentini V, Begg AC, De Ruysscher D, Dekker A. Lambin P, et al. Nat Rev Clin Oncol. 2013 Jan;10(1):27-40. doi: 10.1038/nrclinonc.2012.196. Epub 2012 Nov 20. Nat Rev Clin Oncol. 2013. PMID: 23165123 Free PMC article. Review. - Using multiple types of studies in systematic reviews of health care interventions--a systematic review.
Peinemann F, Tushabe DA, Kleijnen J. Peinemann F, et al. PLoS One. 2013 Dec 26;8(12):e85035. doi: 10.1371/journal.pone.0085035. eCollection 2013. PLoS One. 2013. PMID: 24416098 Free PMC article. Review. - Radiomics As Biomarkers for the Treatment of Non-small Cell Lung Cancer With Stereotactic Body Radiation Therapy: A Review of Concepts.
Ramasamy G, Muanza T. Ramasamy G, et al. Cureus. 2024 Nov 5;16(11):e73082. doi: 10.7759/cureus.73082. eCollection 2024 Nov. Cureus. 2024. PMID: 39640122 Free PMC article. Review. - Methodological Rigor in Preclinical Cardiovascular Studies: Targets to Enhance Reproducibility and Promote Research Translation.
Ramirez FD, Motazedian P, Jung RG, Di Santo P, MacDonald ZD, Moreland R, Simard T, Clancy AA, Russo JJ, Welch VA, Wells GA, Hibbert B. Ramirez FD, et al. Circ Res. 2017 Jun 9;120(12):1916-1926. doi: 10.1161/CIRCRESAHA.117.310628. Epub 2017 Apr 3. Circ Res. 2017. PMID: 28373349 Free PMC article. Review. - Aortic pulse wave velocity improves cardiovascular event prediction: an individual participant meta-analysis of prospective observational data from 17,635 subjects.
Ben-Shlomo Y, Spears M, Boustred C, May M, Anderson SG, Benjamin EJ, Boutouyrie P, Cameron J, Chen CH, Cruickshank JK, Hwang SJ, Lakatta EG, Laurent S, Maldonado J, Mitchell GF, Najjar SS, Newman AB, Ohishi M, Pannier B, Pereira T, Vasan RS, Shokawa T, Sutton-Tyrell K, Verbeke F, Wang KL, Webb DJ, Willum Hansen T, Zoungas S, McEniery CM, Cockcroft JR, Wilkinson IB. Ben-Shlomo Y, et al. J Am Coll Cardiol. 2014 Feb 25;63(7):636-646. doi: 10.1016/j.jacc.2013.09.063. Epub 2013 Nov 13. J Am Coll Cardiol. 2014. PMID: 24239664 Free PMC article. Review.
References
- Hackam DG, Anand SS. Emerging risk factors for atherosclerotic vascular disease: a critical review of the evidence. JAMA 2003;290:932-40. - PubMed
- Tzoulaki I, Liberopoulos G, Ioannidis JP. Assessment of claims of improved prediction beyond the Framingham risk score. JAMA 2009;302:2345-52. - PubMed
- Tzoulaki I, Liberopoulos G, Ioannidis JP. Use of reclassification for assessment of improved prediction: an empirical evaluation. Int J Epidemiol 2011;40:1094-105. - PubMed
- Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR. Publication bias in clinical research. Lancet 1991;337:867-72. - PubMed
Publication types
MeSH terms
Substances
LinkOut - more resources
Full Text Sources
Other Literature Sources
Research Materials