A randomised controlled trial of an Intervention to Improve Compliance with the ARRIVE guidelines (IICARus) - PubMed (original) (raw)

A randomised controlled trial of an Intervention to Improve Compliance with the ARRIVE guidelines (IICARus)

Kaitlyn Hair et al. Res Integr Peer Rev. 2019.

Abstract

Background: The ARRIVE (Animal Research: Reporting of In Vivo Experiments) guidelines are widely endorsed but compliance is limited. We sought to determine whether journal-requested completion of an ARRIVE checklist improves full compliance with the guidelines.

Methods: In a randomised controlled trial, manuscripts reporting in vivo animal research submitted to PLOS ONE (March-June 2015) were randomly allocated to either requested completion of an ARRIVE checklist or current standard practice. Authors, academic editors, and peer reviewers were blinded to group allocation. Trained reviewers performed outcome adjudication in duplicate by assessing manuscripts against an operationalised version of the ARRIVE guidelines that consists 108 items. Our primary outcome was the between-group differences in the proportion of manuscripts meeting all ARRIVE guideline checklist subitems.

Results: We randomised 1689 manuscripts (control: n = 844, intervention: n = 845), of which 1269 were sent for peer review and 762 (control: n = 340; intervention: n = 332) accepted for publication. No manuscript in either group achieved full compliance with the ARRIVE checklist. Details of animal husbandry (ARRIVE subitem 9b) was the only subitem to show improvements in reporting, with the proportion of compliant manuscripts rising from 52.1 to 74.1% (X 2 = 34.0, df = 1, p = 2.1 × 10-7) in the control and intervention groups, respectively.

Conclusions: These results suggest that altering the editorial process to include requests for a completed ARRIVE checklist is not enough to improve compliance with the ARRIVE guidelines. Other approaches, such as more stringent editorial policies or a targeted approach on key quality items, may promote improvements in reporting.

Keywords: ARRIVE; Randomised controlled trial; Reporting guidelines.

PubMed Disclaimer

Conflict of interest statement

Competing interestsES and MM are in receipt of competitive research grants from the NC3Rs who developed the ARRIVE guidelines. SL was funded by an NC3Rs PhD studentship. ES, MM, DH, and NK are members of an NC3Rs working group to review the ARRIVE guidelines (https://www.nc3rs.org.uk/revision-arrive-guidelines). CM, GM, AC, GA, and MD were all editors at PLOS ONE throughout the duration of the study. ES is Editor-in-Chief at BMJ Open Science. All other authors have no other competing interests to declare.

Figures

Fig. 1

Fig. 1

Manuscript processing

Fig. 2

Fig. 2

Percentage compliance for each ARRIVE subitem; percentage compliance for each ARRIVE subitem with 95% confidence intervals; asterisk denotes statistical significance; figure divided into article sections specified in the ARRIVE guidelines

Fig. 3

Fig. 3

Compliance by country; percentage compliance for each ARRIVE subitem for manuscripts in each country (for countries with N manuscripts ≥10)

Fig. 4

Fig. 4

Landis 4 individual compliance; percentage compliance for each Landis criteria present in the ARRIVE guidelines with 95% confidence intervals

Similar articles

Cited by

References

    1. Aickin M, Gensler H. Adjusting for multiple testing when reporting research results: the Bonferroni vs Holm methods. Am J Public Health. 1996;86:726–728. doi: 10.2105/AJPH.86.5.726. - DOI - PMC - PubMed
    1. Avey MT, Moher D, Sullivan KJ, Fergusson D, Griffin G, Grimshaw JM, Hutton B, Lalu MM, Macleod M, Marshall J, Mei SHJ, Rudnicki M, Stewart DJ, Turgeon AF, Mcintyre L, Canadian Critical Care Translational Biology, G The devil is in the details: incomplete reporting in preclinical animal research. PLoS One. 2016;11:e0166733. doi: 10.1371/journal.pone.0166733. - DOI - PMC - PubMed
    1. Baker D, Lidster K, Sottomayor A, Amor S. Two years later: journals are not yet enforcing the ARRIVE guidelines on reporting standards for pre-clinical animal studies. PLoS Biol. 2014;12:e1001756. doi: 10.1371/journal.pbio.1001756. - DOI - PMC - PubMed
    1. Blanco David, Kirkham Jamie J, Altman Douglas G, Moher David, Boutron Isabelle, Cobo Erik. Interventions to improve adherence to reporting guidelines in health research: a scoping review protocol. BMJ Open. 2017;7(11):e017551. doi: 10.1136/bmjopen-2017-017551. - DOI - PMC - PubMed
    1. Cobo E, Cortes J, Ribera JM, Cardellach F, Selva-O’Callaghan A, Kostov B, Garcia L, Cirugeda L, Altman DG, Gonzalez JA, Sanchez JA, Miras F, Urrutia A, Fonollosa V, Rey-Joly C, Vilardell M. Effect of using reporting guidelines during peer review on quality of final manuscripts submitted to a biomedical journal: masked randomised trial. BMJ. 2011;343:d6783. doi: 10.1136/bmj.d6783. - DOI - PMC - PubMed

LinkOut - more resources