An Observational Study of Deep Learning and Automated Evaluation of Cervical Images for Cancer Screening - PubMed (original) (raw)
. 2019 Sep 1;111(9):923-932.
doi: 10.1093/jnci/djy225.
David Bell, Sameer Antani, Zhiyun Xue, Kai Yu, Matthew P Horning, Noni Gachuhi, Benjamin Wilson, Mayoore S Jaiswal, Brian Befano, L Rodney Long, Rolando Herrero, Mark H Einstein, Robert D Burk, Maria Demarco, Julia C Gage, Ana Cecilia Rodriguez, Nicolas Wentzensen, Mark Schiffman
- PMID: 30629194
- PMCID: PMC6748814
- DOI: 10.1093/jnci/djy225
An Observational Study of Deep Learning and Automated Evaluation of Cervical Images for Cancer Screening
Liming Hu et al. J Natl Cancer Inst. 2019.
Abstract
Background: Human papillomavirus vaccination and cervical screening are lacking in most lower resource settings, where approximately 80% of more than 500 000 cancer cases occur annually. Visual inspection of the cervix following acetic acid application is practical but not reproducible or accurate. The objective of this study was to develop a "deep learning"-based visual evaluation algorithm that automatically recognizes cervical precancer/cancer.
Methods: A population-based longitudinal cohort of 9406 women ages 18-94 years in Guanacaste, Costa Rica was followed for 7 years (1993-2000), incorporating multiple cervical screening methods and histopathologic confirmation of precancers. Tumor registry linkage identified cancers up to 18 years. Archived, digitized cervical images from screening, taken with a fixed-focus camera ("cervicography"), were used for training/validation of the deep learning-based algorithm. The resultant image prediction score (0-1) could be categorized to balance sensitivity and specificity for detection of precancer/cancer. All statistical tests were two-sided.
Results: Automated visual evaluation of enrollment cervigrams identified cumulative precancer/cancer cases with greater accuracy (area under the curve [AUC] = 0.91, 95% confidence interval [CI] = 0.89 to 0.93) than original cervigram interpretation (AUC = 0.69, 95% CI = 0.63 to 0.74; P < .001) or conventional cytology (AUC = 0.71, 95% CI = 0.65 to 0.77; P < .001). A single visual screening round restricted to women at the prime screening ages of 25-49 years could identify 127 (55.7%) of 228 precancers (cervical intraepithelial neoplasia 2/cervical intraepithelial neoplasia 3/adenocarcinoma in situ [AIS]) diagnosed cumulatively in the entire adult population (ages 18-94 years) while referring 11.0% for management.
Conclusions: The results support consideration of automated visual evaluation of cervical images from contemporary digital cameras. If achieved, this might permit dissemination of effective point-of-care cervical screening.
Published by Oxford University Press 2019.
Figures
Figure 1.
Cervical images used for training and validation. The images were drawn from the Proyecto Epidemiologico Guanacaste, a longitudinal cohort study of human papillomavirus infection, other screening tests, and risk of cervical precancer/cancer (1993β2001). The training and initial validation made use of the last images taken prior to case diagnosis and approximately 3:1 controls frequency matched to cases on time of study (enrollment/follow-up). The main analysis focused on images (excluding all images from women in the training set) from cohort enrollment and examined how the automated image analysis of enrollment screening images performed in prediction of cases found over the course of the entire cohort study. In an analysis that counted the absolute numbers of cases detected and controls referred, it was necessary to reweight, that is, to multiply the findings in the randomly selected validation test by the inverse of the 30% sampling fraction to estimate numbers for all cases and matched controls (see Methods). CIN = cervical intraepithelial neoplasia.
Figure 2.
The system architecture of the automated visual evaluation algorithm. Two models are trained: a cervix locator (top), and the automated visual evaluation detection algorithm (bottom). The final validation algorithm incorporated both cervix locator and automated visual evaluation.
Figure 3.
Comparison of the mean scores obtained by comparing enrollment images from women whose worst diagnosis within the cohort was cervical intraepithelial neoplasia (CIN) 2, CIN3, or cancer. These subsets of the cases were not statistically significantly different with regard to severity scores generated by the algorithm. Therefore, we combined all into a single case group. We show a box and whisker plot of 32 CIN2, 38 CIN3, and seven cancers, giving quartiles, means, and outliers of case probability for each diagnosis within the cohort.
Figure 4.
Receiver operating characteristic (ROC) curve of automated visual evaluation of cervical images and comparison of performance in identification of cervical intraepithelial neoplasia 2+. ROC-like curves are shown for the categorical variables for simple visual and statistical comparison with automated visual evaluation (two-sided chi-squared tests). The thresholds are listed on each curve, showing the sensitivity and 1-specificity applicable to that cutpoint. Automated visual evaluation was as accurate or more than all of the screening tests used in the cohort study, including: A) automated visual evaluation; B) cervicography: area under the curve (AUC); C) conventional Pap smear; D) liquid-based cytology; E) first-generation neural network-based cytology; and F) MY09-MY11 PCR-based human papillomavirus (HPV) testing. ASC-US = atypical squamous cells of undetermined significance; HSIL = high-grade squamous intraepithelial lesion; LSIL = low-grade squamous intraepithelial lesion.
Comment in
- Shining Light Into the Black Box of Machine Learning.
Hsu W, Elmore JG. Hsu W, et al. J Natl Cancer Inst. 2019 Sep 1;111(9):877-879. doi: 10.1093/jnci/djy226. J Natl Cancer Inst. 2019. PMID: 30629201 Free PMC article. No abstract available. - Contemporary Issues in Women's Health.
Geary M, Chibwesha C, Stringer E. Geary M, et al. Int J Gynaecol Obstet. 2019 Jul;146(1):36-38. doi: 10.1002/ijgo.12845. Int J Gynaecol Obstet. 2019. PMID: 31173357 - Re: An Observational Study of Deep Learning and Automated Evaluation of Cervical Images for Cancer Screening.
Pretorius RG, Belinson JL. Pretorius RG, et al. J Natl Cancer Inst. 2020 Jan 1;112(1):114. doi: 10.1093/jnci/djz115. J Natl Cancer Inst. 2020. PMID: 31187115 No abstract available. - Response to Pretorius and Belinson.
Schiffman M, Hu L, Antani S, Wentzensen N. Schiffman M, et al. J Natl Cancer Inst. 2020 Jan 1;112(1):115-116. doi: 10.1093/jnci/djz119. J Natl Cancer Inst. 2020. PMID: 31187134 Free PMC article. No abstract available.
Similar articles
- Deep learning based cervical screening by the cross-modal integration of colposcopy, cytology, and HPV test.
Fu L, Xia W, Shi W, Cao GX, Ruan YT, Zhao XY, Liu M, Niu SM, Li F, Gao X. Fu L, et al. Int J Med Inform. 2022 Mar;159:104675. doi: 10.1016/j.ijmedinf.2021.104675. Epub 2021 Dec 28. Int J Med Inform. 2022. PMID: 34979436 - The application of deep learning based diagnostic system to cervical squamous intraepithelial lesions recognition in colposcopy images.
Yuan C, Yao Y, Cheng B, Cheng Y, Li Y, Li Y, Liu X, Cheng X, Xie X, Wu J, Wang X, Lu W. Yuan C, et al. Sci Rep. 2020 Jul 15;10(1):11639. doi: 10.1038/s41598-020-68252-3. Sci Rep. 2020. PMID: 32669565 Free PMC article. - A demonstration of automated visual evaluation of cervical images taken with a smartphone camera.
Xue Z, Novetsky AP, Einstein MH, Marcus JZ, Befano B, Guo P, Demarco M, Wentzensen N, Long LR, Schiffman M, Antani S. Xue Z, et al. Int J Cancer. 2020 Nov 1;147(9):2416-2423. doi: 10.1002/ijc.33029. Epub 2020 May 19. Int J Cancer. 2020. PMID: 32356305 - Pattern Classification of Images from Acetic Acid-Based Cervical Cancer Screening: A Review.
Kudva V, Prasad K. Kudva V, et al. Crit Rev Biomed Eng. 2018;46(2):117-133. doi: 10.1615/CritRevBiomedEng.2018026017. Crit Rev Biomed Eng. 2018. PMID: 30055529 Review. - Screening for Cervical Cancer With High-Risk Human Papillomavirus Testing: A Systematic Evidence Review for the U.S. Preventive Services Task Force [Internet].
Melnikow J, Henderson JT, Burda BU, Senger CA, Durbin S, Soulsby MA. Melnikow J, et al. Rockville (MD): Agency for Healthcare Research and Quality (US); 2018 Aug. Report No.: 17-05231-EF-1. Rockville (MD): Agency for Healthcare Research and Quality (US); 2018 Aug. Report No.: 17-05231-EF-1. PMID: 30256575 Free Books & Documents. Review.
Cited by
- Optical imaging for screening and early cancer diagnosis in low-resource settings.
Richards-Kortum R, Lorenzoni C, Bagnato VS, Schmeler K. Richards-Kortum R, et al. Nat Rev Bioeng. 2024 Jan;2(1):25-43. doi: 10.1038/s44222-023-00135-4. Epub 2023 Dec 22. Nat Rev Bioeng. 2024. PMID: 39301200 Free PMC article. - Triage performance of PAX1m/JAM3m in opportunistic cervical cancer screening of nonβ16/18 human papillomavirus-positive women: a multicenter prospective study in China.
Chen X, Jin X, Kong L, Liou Y, Liu P, Dong Z, Zhou S, Qi B, Fei J, Chen X, Xiong G, Hu Y, Liu S, Zhou J, Shou H, Li L. Chen X, et al. Clin Epigenetics. 2024 Aug 16;16(1):108. doi: 10.1186/s13148-024-01731-w. Clin Epigenetics. 2024. PMID: 39152491 Free PMC article. - Diagnostic Efficacy of Enhanced Visual Assessment [Visual Check] for Triaging Cervical Cancer Screen Positive Women.
Shamsunder S, Mishra A, Kumar A, Beriwal R, Ahluwalia C, Das S. Shamsunder S, et al. J Midlife Health. 2024 Apr-Jun;15(2):69-74. doi: 10.4103/jmh.jmh_204_23. Epub 2024 Jul 5. J Midlife Health. 2024. PMID: 39145263 Free PMC article. - Lightweight Low-Rank Adaptation Vision Transformer Framework for Cervical Cancer Detection and Cervix Type Classification.
Hong Z, Xiong J, Yang H, Mo YK. Hong Z, et al. Bioengineering (Basel). 2024 May 8;11(5):468. doi: 10.3390/bioengineering11050468. Bioengineering (Basel). 2024. PMID: 38790335 Free PMC article. - Artificial intelligence enables precision diagnosis of cervical cytology grades and cervical cancer.
Wang J, Yu Y, Tan Y, Wan H, Zheng N, He Z, Mao L, Ren W, Chen K, Lin Z, He G, Chen Y, Chen R, Xu H, Liu K, Yao Q, Fu S, Song Y, Chen Q, Zuo L, Wei L, Wang J, Ouyang N, Yao H. Wang J, et al. Nat Commun. 2024 May 22;15(1):4369. doi: 10.1038/s41467-024-48705-3. Nat Commun. 2024. PMID: 38778014 Free PMC article.
References
- Bray F, Jemal A, Grey N, Ferlay J, Forman D.. Global cancer transitions according to the Human Development Index (2008-2030): a population-based study. Lancet Oncol. 2012;138:790β801. - PubMed
- Schiffman M, Doorbar J, Wentzensen N, et al. Carcinogenic human papillomavirus infection. Nat Rev Dis Primers. 2016;2(2):16086. - PubMed
- Bagcchi S. India launches plan for national cancer screening programme. BMJ. 2016;355;i5574. - PubMed
- WHO Guidelines Approved by the Guidelines Review Committee. WHO Guidelines for Screening and Treatment of Precancerous Lesions for Cervical Cancer Prevention. Geneva: World Health Organization; 2013. - PubMed
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
Medical