Relation of completeness of reporting of health research to journals' endorsement of reporting guidelines: systematic review - PubMed (original) (raw)
Review
doi: 10.1136/bmj.g3804.
Larissa Shamseer 2, Erica Weinstein 3, Fatemeh Yazdi 1, Lucy Turner 1, Justin Thielman 1, Douglas G Altman 4, Allison Hirst 5, John Hoey 6, Anita Palepu 7, Kenneth F Schulz 8, David Moher 9
Affiliations
- PMID: 24965222
- PMCID: PMC4070413
- DOI: 10.1136/bmj.g3804
Review
Relation of completeness of reporting of health research to journals' endorsement of reporting guidelines: systematic review
Adrienne Stevens et al. BMJ. 2014.
Abstract
Objective: To assess whether the completeness of reporting of health research is related to journals' endorsement of reporting guidelines.
Design: Systematic review.
Data sources: Reporting guidelines from a published systematic review and the EQUATOR Network (October 2011). Studies assessing the completeness of reporting by using an included reporting guideline (termed "evaluations") (1990 to October 2011; addendum searches in January 2012) from searches of either Medline, Embase, and the Cochrane Methodology Register or Scopus, depending on reporting guideline name.
Study selection: English language reporting guidelines that provided explicit guidance for reporting, described the guidance development process, and indicated use of a consensus development process were included. The CONSORT statement was excluded, as evaluations of adherence to CONSORT had previously been reviewed. English or French language evaluations of included reporting guidelines were eligible if they assessed the completeness of reporting of studies as a primary intent and those included studies enabled the comparisons of interest (that is, after versus before journal endorsement and/or endorsing versus non-endorsing journals).
Data extraction: Potentially eligible evaluations of included guidelines were screened initially by title and abstract and then as full text reports. If eligibility was unclear, authors of evaluations were contacted; journals' websites were consulted for endorsement information where needed. The completeness of reporting of reporting guidelines was analyzed in relation to endorsement by item and, where consistent with the authors' analysis, a mean summed score.
Results: 101 reporting guidelines were included. Of 15,249 records retrieved from the search for evaluations, 26 evaluations that assessed completeness of reporting in relation to endorsement for nine reporting guidelines were identified. Of those, 13 evaluations assessing seven reporting guidelines (BMJ economic checklist, CONSORT for harms, PRISMA, QUOROM, STARD, STRICTA, and STROBE) could be analyzed. Reporting guideline items were assessed by few evaluations.
Conclusions: The completeness of reporting of only nine of 101 health research reporting guidelines (excluding CONSORT) has been evaluated in relation to journals' endorsement. Items from seven reporting guidelines were quantitatively analyzed, by few evaluations each. Insufficient evidence exists to determine the relation between journals' endorsement of reporting guidelines and the completeness of reporting of published health research reports. Journal editors and researchers should consider collaborative prospectively designed, controlled studies to provide more robust evidence.
Systematic review registration: Not registered; no known register currently accepts protocols for methodology systematic reviews.
© Stevens et al 2014.
Conflict of interest statement
Competing interests: All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi\_disclosure.pdf (available on request from the corresponding author) and declare: all authors maintained their independence from the agency that funded this work; no financial relationships with any organizations that might have an interest in the submitted work in the previous three years; no other relationships or activities that could appear to have influenced the submitted work.
Figures
Fig 1 Schematic depicting relation among evaluation of reporting guideline, studies contained within it, and determination of comparison groups according to journal endorsement status
Fig 2 PRISMA flow diagram for selecting reporting guidelines for health research. RG=reporting guideline
Fig 3 PRISMA flow diagram for selecting evaluations of relevant reporting guidelines. RG=reporting guideline; SR=systematic review
Fig 4 Completeness of reporting summary plot for BMJ economics checklist, endorsing versus non-endorsing journals. Summary plots in this and other related figures were generated in Comprehensive Meta-analysis. In brief, summary effect estimates for each checklist are shown, and those estimates were previously calculated in Review Manager. For example, checklist item “economic importance of question” was assessed in only one evaluation, which had 13 studies (2 studies from endorsing journal and 11 studies from non-endorsing journals; appendix 7) that provided information on whether study had reported on that checklist item. Appendix 7 shows analyses for each checklist item conducted in Review Manager
Fig 5 Completeness of reporting summary plot for CONSORT extension for harms checklist, endorsing versus non-endorsing journals
Fig 6 Completeness of reporting summary plot for PRISMA checklist, endorsing versus non-endorsing journals. Although all evaluations assessed all items, one evaluation was excluded from analysis of two checklist items because of zero or one studies for analysis
Fig 7 Completeness of reporting summary plot for STARD checklist, endorsing versus non-endorsing journals. Effect estimate for checklist item “Test methods: definition of cut-offs of index test and reference standard” was not estimable during quantitative analysis because of zero events in each arm (one evaluation in analysis)
Fig 8 Completeness of reporting summary plot for STRICTA checklist, endorsing versus non-endorsing journals
Fig 9 Completeness of reporting summary plot for STROBE checklist, endorsing versus non-endorsing journals. Effect estimate for checklist item “Methods: missing data” was not estimable during quantitative analysis because of zero events in each arm
Fig 10 Completeness of reporting summary plot for PRISMA checklist, after versus before journal endorsement. Although all evaluations assessed all items, one evaluation was excluded from analysis of one checklist item because of zero and one studies for comparison arms
Fig 11 Completeness of reporting summary plot for QUOROM checklist, after versus before journal endorsement
Fig 12 Completeness of reporting summary plot for STARD checklist, after versus before journal endorsement
Fig 13 Completeness of reporting summary plot for STRICTA checklist, after versus before journal endorsement
Fig 14 Completeness of reporting summary plot for STROBE checklist, after versus before journal endorsement. Effect estimate for checklist item “Methods: missing data” was not estimable during quantitative analysis because of zero events in each arm
Similar articles
- Consolidated standards of reporting trials (CONSORT) and the completeness of reporting of randomised controlled trials (RCTs) published in medical journals.
Turner L, Shamseer L, Altman DG, Weeks L, Peters J, Kober T, Dias S, Schulz KF, Plint AC, Moher D. Turner L, et al. Cochrane Database Syst Rev. 2012 Nov 14;11(11):MR000030. doi: 10.1002/14651858.MR000030.pub2. Cochrane Database Syst Rev. 2012. PMID: 23152285 Free PMC article. Review. - Does journal endorsement of reporting guidelines influence the completeness of reporting of health research? A systematic review protocol.
Shamseer L, Stevens A, Skidmore B, Turner L, Altman DG, Hirst A, Hoey J, Palepu A, Simera I, Schulz K, Moher D. Shamseer L, et al. Syst Rev. 2012 May 24;1:24. doi: 10.1186/2046-4053-1-24. Syst Rev. 2012. PMID: 22626029 Free PMC article. - Impact of the CONSORT Statement endorsement in the completeness of reporting of randomized clinical trials in restorative dentistry.
Sarkis-Onofre R, Poletto-Neto V, Cenci MS, Pereira-Cenci T, Moher D. Sarkis-Onofre R, et al. J Dent. 2017 Mar;58:54-59. doi: 10.1016/j.jdent.2017.01.009. Epub 2017 Jan 31. J Dent. 2017. PMID: 28159507 - Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas.
Crider K, Williams J, Qi YP, Gutman J, Yeung L, Mai C, Finkelstain J, Mehta S, Pons-Duran C, Menéndez C, Moraleda C, Rogers L, Daniels K, Green P. Crider K, et al. Cochrane Database Syst Rev. 2022 Feb 1;2(2022):CD014217. doi: 10.1002/14651858.CD014217. Cochrane Database Syst Rev. 2022. PMID: 36321557 Free PMC article. - Does use of the CONSORT Statement impact the completeness of reporting of randomised controlled trials published in medical journals? A Cochrane review.
Turner L, Shamseer L, Altman DG, Schulz KF, Moher D. Turner L, et al. Syst Rev. 2012 Nov 29;1:60. doi: 10.1186/2046-4053-1-60. Syst Rev. 2012. PMID: 23194585 Free PMC article. Review.
Cited by
- The policies on the use of large language models in radiological journals are lacking: a meta-research study.
Zhong J, Xing Y, Hu Y, Lu J, Yang J, Zhang G, Mao S, Chen H, Yin Q, Cen Q, Jiang R, Chu J, Song Y, Lu M, Ding D, Ge X, Zhang H, Yao W. Zhong J, et al. Insights Imaging. 2024 Aug 1;15(1):186. doi: 10.1186/s13244-024-01769-7. Insights Imaging. 2024. PMID: 39090273 Free PMC article. - The Reporting of a Disproportionality Analysis for Drug Safety Signal Detection Using Individual Case Safety Reports in PharmacoVigilance (READUS-PV): Development and Statement.
Fusaroli M, Salvo F, Begaud B, AlShammari TM, Bate A, Battini V, Brueckner A, Candore G, Carnovale C, Crisafulli S, Cutroneo PM, Dolladille C, Drici MD, Faillie JL, Goldman A, Hauben M, Herdeiro MT, Mahaux O, Manlik K, Montastruc F, Noguchi Y, Norén GN, Noseda R, Onakpoya IJ, Pariente A, Poluzzi E, Salem M, Sartori D, Trinh NTH, Tuccori M, van Hunsel F, van Puijenbroek E, Raschi E, Khouri C. Fusaroli M, et al. Drug Saf. 2024 Jun;47(6):575-584. doi: 10.1007/s40264-024-01421-9. Epub 2024 May 7. Drug Saf. 2024. PMID: 38713346 Free PMC article. - Reporting of equity in observational epidemiology: A methodological review.
Dewidar O, Al-Zubaidi A, Bondok M, Abdelrazeq L, Huang J, Jearvis A, Barker LC, Elmestekawy N, Goghomu E, Rader T, Tufte J, Greer-Smith R, Waddington HS, Nicholls SG, Little J, Hardy BJ, Horsley T, Young T, Cuervo LG, Sharp MK, Chamberlain C, Shea B, Craig P, Lawson DO, Rizvi A, Wiysonge CS, Kredo T, Francis D, Kristjansson E, Bhutta Z, Antequera A, Melendez-Torres GJ, Pantoja T, Wang X, Jull J, Roberts JH, Funnell S, White H, Krentel A, Mahande MJ, Ramke J, Wells G, Petkovic J, Pottie K, Niba L, Feng C, Nguliefem MN, Tugwell P, Mbuagbaw L, Welch V. Dewidar O, et al. J Glob Health. 2024 Mar 1;14:04046. doi: 10.7189/jogh.14.04046. J Glob Health. 2024. PMID: 38491911 Free PMC article. Review. - Endorsements of five reporting guidelines for biomedical research by journals of prominent publishers.
Wang P, Wolfram D, Gilbert E. Wang P, et al. PLoS One. 2024 Feb 29;19(2):e0299806. doi: 10.1371/journal.pone.0299806. eCollection 2024. PLoS One. 2024. PMID: 38421981 Free PMC article. - Guidelines for reporting pediatric and child health clinical trial protocols and reports: study protocol for SPIRIT-Children and CONSORT-Children.
Baba A, Smith M, Potter BK, Chan AW, Moher D, Offringa M. Baba A, et al. Trials. 2024 Jan 30;25(1):96. doi: 10.1186/s13063-024-07948-7. Trials. 2024. PMID: 38287439 Free PMC article.
References
- Chan AW, Altman DG. Epidemiology and reporting of randomised trials published in PubMed journals. Lancet 2005;365:1159-62. - PubMed
- Chan S, Bhandari M. The quality of reporting of orthopaedic randomized trials with use of a checklist for nonpharmacological therapies. J Bone Joint Surg Am 2007;89:1970-8. - PubMed
- Smith BA, Lee HJ, Lee JH, Choi M, Jones DE, Bausell RB, et al. Quality of reporting randomized controlled trials (RCTs) in the nursing literature: application of the consolidated standards of reporting trials (CONSORT). Nurs Outlook 2008;56(1):31-7. - PubMed
Publication types
MeSH terms
Grants and funding
- 16895/CRUK_/Cancer Research UK/United Kingdom
- MR/J00488X/1/MRC_/Medical Research Council/United Kingdom
- KSD-111750/CAPMC/ CIHR/Canada
- CSO_/Chief Scientist Office/United Kingdom
LinkOut - more resources
Full Text Sources
Other Literature Sources