An effective biomedical document classification scheme in support of biocuration: addressing class imbalance - PubMed (original) (raw)

An effective biomedical document classification scheme in support of biocuration: addressing class imbalance

Xiangying Jiang et al. Database (Oxford). 2019.

Abstract

Published literature is an important source of knowledge supporting biomedical research. Given the large and increasing number of publications, automated document classification plays an important role in biomedical research. Effective biomedical document classifiers are especially needed for bio-databases, in which the information stems from many thousands of biomedical publications that curators must read in detail and annotate. In addition, biomedical document classification often amounts to identifying a small subset of relevant publications within a much larger collection of available documents. As such, addressing class imbalance is essential to a practical classifier. We present here an effective classification scheme for automatically identifying papers among a large pool of biomedical publications that contain information relevant to a specific topic, which the curators are interested in annotating. The proposed scheme is based on a meta-classification framework using cluster-based under-sampling combined with named-entity recognition and statistical feature selection strategies. We examined the performance of our method over a large imbalanced data set that was originally manually curated by the Jackson Laboratory's Gene Expression Database (GXD). The set consists of more than 90 000 PubMed abstracts, of which about 13 000 documents are labeled as relevant to GXD while the others are not relevant. Our results, 0.72 precision, 0.80 recall and 0.75 f-measure, demonstrate that our proposed classification scheme effectively categorizes such a large data set in the face of data imbalance.

© The Author(s) 2019. Published by Oxford University Press.

PubMed Disclaimer

Figures

Similar articles

Cited by

References

    1. Chen D., Müller H.M. and Sternberg P.W. (2006) Automatic document classification of biological literature. BMC Bioinformatics, 7, 370. - PMC - PubMed
    1. Fang R., Schindelman G., Van Auken K. et al. (2012) Automatic categorization of diverse experimental information in the bioscience literature. BMC Bioinformatics, 13, 16. - PMC - PubMed
    1. Li D., Berardini T.Z., Muller R.J. et al. (2012) Building an efficient curation workflow for the Arabidopsis literature corpus. Database, 2012, bas047. - PMC - PubMed
    1. Hirschman L., Burns G.A., Kralinger M. et al. (2012) Text mining for the biocuration workflow. Database, 2012, bas020. - PMC - PubMed
    1. Almeida H., Meurs M.J., Kosseim L. et al. (2014) Machine learning for biomedical literature triage. PloS One, 9, e115892. - PMC - PubMed

Publication types

MeSH terms

Grants and funding

LinkOut - more resources