Blacklists and Whitelists To Tackle Predatory Publishing: a Cross-Sectional Comparison and Thematic Analysis - PubMed (original) (raw)

Comparative Study

Blacklists and Whitelists To Tackle Predatory Publishing: a Cross-Sectional Comparison and Thematic Analysis

Michaela Strinzel et al. mBio. 2019.

Erratum in

Abstract

We aimed to develop an in-depth understanding of quality criteria for scholarly journals by analyzing journals and publishers indexed in blacklists of predatory journals and whitelists of legitimate journals and the lists' inclusion criteria. To quantify content overlaps between blacklists and whitelists, we employed the Jaro-Winkler string metric. To identify topics addressed by the lists' inclusion criteria and to derive their concepts, we conducted qualitative coding. We included two blacklists (Beall's and Cabells Scholarly Analytics') and two whitelists (the Directory of Open Access Journals' and Cabells Scholarly Analytics'). The number of journals per list ranged from 1,404 to 12,357, and the number of publishers ranged from 473 to 5,638. Seventy-two journals and 42 publishers were included in both a blacklist and a whitelist. Seven themes were identified in the inclusion criteria: (i) peer review; (ii) editorial services; (iii) policy; (iv) business practices; (v) publishing, archiving, and access; (vi) website; and (vii) indexing and metrics. Business practices accounted for almost half of the blacklists' criteria, whereas whitelists gave more emphasis to criteria related to policy. Criteria could be allocated to four concepts: (i) transparency, (ii) ethics, (iii) professional standards, and (iv) peer review and other services. Whitelists gave most weight to transparency. Blacklists focused on ethics and professional standards. Whitelist criteria were easier to verify than those used in blacklists. Both types gave little emphasis to quality of peer review. Overall, the results show that there is overlap of journals and publishers between blacklists and whitelists. Lists differ in their criteria for quality and the weight given to different dimensions of quality. Aspects that are central but difficult to verify receive little attention.IMPORTANCE Predatory journals are spurious scientific outlets that charge fees for editorial and publishing services that they do not provide. Their lack of quality assurance of published articles increases the risk that unreliable research is published and thus jeopardizes the integrity and credibility of research as a whole. There is increasing awareness of the risks associated with predatory publishing, but efforts to address this situation are hampered by the lack of a clear definition of predatory outlets. Blacklists of predatory journals and whitelists of legitimate journals have been developed but not comprehensively examined. By systematically analyzing these lists, this study provides insights into their utility and delineates the different notions of quality and legitimacy in scholarly publishing used. This study contributes to a better understanding of the relevant concepts and provides a starting point for the development of a robust definition of predatory journals.

Keywords: journal whitelists and blacklists; open access; peer review; predatory publishing; publishing ethics; scholarly communication; transparency.

Copyright © 2019 Strinzel et al.

PubMed Disclaimer

Figures

FIG 1

FIG 1

Venn diagrams of journal overlaps between Beall's list, Cabell's blacklist, the DOAJ, and Cabell’s whitelist (as of December 2018).

FIG 2

FIG 2

Venn diagram of publisher overlap between Beall's list, Cabell's blacklist, the DOAJ, and Cabell's whitelist (as of December 2018).

FIG 3

FIG 3

Distribution of inclusion criteria across seven thematic topics for whitelists and blacklists.

FIG 4

FIG 4

Distribution of inclusion criteria across seven thematic topics for the four lists.

FIG 5

FIG 5

Distribution of inclusion criteria across four concepts for blacklists (BL) and whitelists (WL).

FIG 6

FIG 6

Distribution of inclusion criteria across four concepts for all four lists individually.

FIG 7

FIG 7

Procedure of the quantitative comparison of blacklists and whitelists.

Similar articles

Cited by

References

    1. Shamseer L, Moher D, Maduekwe O, Turner L, Barbour V, Burch R, 2017. Potential predatory and legitimate biomedical journals: can you tell the difference? A cross-sectional comparison. BMC Med 15:28. doi:10.1186/s12916-017-0785-9. - DOI - PMC - PubMed
    1. Masic I. 2017. Predatory publishing—experience with OMICS International. Med Arch 71:304. doi:10.5455/medarh.2017.71.304-307. - DOI - PMC - PubMed
    1. Shen C, Björk B-C. 2015. ‘Predatory’ open access: a longitudinal study of article volumes and market characteristics. BMC Med 13:230. doi:10.1186/s12916-015-0469-2. - DOI - PMC - PubMed
    1. Giglio VJ, Luiz OJ. 2017. Predatory journals: fortify the defences. Nature 544:416. doi:10.1038/544416a. - DOI - PubMed
    1. Alecci S. 20 July 2018. New global investigation tackles poisonous effects of ‘fake science.’ International Consortium of Investigative Journalists Blog; https://www.icij.org/blog/2018/07/new-international-investigation-tackle.... Accessed 2 December 2018.

Publication types

MeSH terms

LinkOut - more resources