An Image Diagnosis Algorithm for Keratitis Based on Deep Learning (original) (raw)

Abstract

Clinical diagnosis of keratitis highly depends on the observation of medical images. Since there are many classifications of keratitis, and the pathogenic factors are different, ophthalmologists will be more demanding. In this paper, a multi-task recognition method is proposed for the automatic diagnosis of keratitis. The diagnosis basis of keratitis is obtained, and the image of the anterior segment is interpreted. Under the guidance of ophthalmologists, all anterior segment images are labeled from five signs, consisting of opacity area in the cornea (turbid and clear), boundary of the focus (distinct and vague), epithelium of the focus area (intact and incomplete), hyperemia (congestive and healthy), and neovascularization (yes and no), which are important in the diagnosis of keratitis. A multi-label image dataset is constructed, and the images are enhanced by horizontal flipping according to the image characteristics. In this paper, an improved multi-attribute network based on ResNet50 is proposed, including a feature extraction module and a classification module. The feature extraction module is to extract image features, and the classification module is a multi-output network in which each channel corresponds to each attribute. In order to improve the overall recognition accuracy of multi-task, the loss function is optimized. In the loss function, the loss weights of different tasks are determined based on the classification difficulty. A joint training approach is used to train the multi-attribute network which can simultaneously recognize the five attributes and obtain the specific symptoms of keratitis. The experimental results show that the average accuracy of these five attributes can be achieved 84.89% in the multi-attribute network, among which the highest accuracy can be achieved 89.51%.

Access this article

Log in via an institution

Subscribe and save

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Painter R (2015) Slit lamp photography: the basics. J Audiov Media Med 38(1–2):119–123
    Google Scholar
  2. Armstrong SM, Cohen KL (2017) Anterior segment OCT: posterior segment imaging, anterior eye photography, and slit lamp biomicrography. Ophthalmic Imaging
  3. Meng K, Zhou CC (2012) Multi-disciplinary intersection and integration: the development tendency and the change in meteorology in colleges. Value Eng 36:219–220
    Google Scholar
  4. Patel VL et al (2009) The coming of age of artificial intelligence in medicine. Artif Intel Med 46:5–17
    Article Google Scholar
  5. Plis SM et al (2014) Deep learning for neuroimaging: a validation study. Front Neurosci 8:229
    Article Google Scholar
  6. Shen D, Wu G, Suk HI (2017) Deep learning in medical image analysis. Annu Rev Biomed Eng 19:221–248
    Article Google Scholar
  7. Lecun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436
    Article Google Scholar
  8. Schmidhuber J (2015) rgen. Deep learning in neural networks. Elsevier Science Ltd., Amsterdam
  9. Gulshan V, Peng L, Coram M, Stumpe MC, Wu D, Narayanaswamy A, Venugopalan S, Widner K, Madams T, Cuadros J, Kim R (2016) Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 316(22):2402–2410
    Article Google Scholar
  10. Johnson J, Karpathy A, Fei-Fei L (2016) DenseCap: fully convolutional localization networks for dense captioning. In: IEEE Conference on Computer Vision and Pattern Recognition. Seattle, WA. IEEE. p 4565–74
  11. Liu Z, Gao J, Yang G, Zhang H, He Y (2016) Localization and classifcation of paddy feld pests using a saliency map and deep convolutional neural network. Sci Rep 6:20410
    Article Google Scholar
  12. Perednia DA, Allen A. Telemedicine technology and clinical applications. JAMA 1995 Feb 08,273(6):483–488. [Medline: 7837367]
  13. Hao X, Zhang G, Ma S (2016) Deep learning. Int J Semantic Comput 10(03):417–439
    Article Google Scholar
  14. Goodfellow I, Bengio Y, Courville A (2016) Deep learning. The MIT Press, Cambridge
    MATH Google Scholar
  15. Alpaydin E (2016) Neural networks and deep learning. Machine learning: the new AI. MIT Press, Cambridge
  16. Theodoridis S (2016) Neural networks and deep learning. Machine Learning
  17. Lecun Y, Bottou L (1998) Gradient-based learning applied to document recognition[J]. Proc IEEE 86(11):2278–2324
    Article Google Scholar
  18. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, pp 1097–1105
  19. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556
  20. Szegedy C, Liu W, Jia YQ et al. (2015) Going deeper with convolutions. IEEE Conference on Computer Vision and Pattern Recognition. pp 1–9
  21. Szegedy C, Vanhoucke V, Ioffe S et al. (2016) Rethinking the Inception Architecture for Computer Vision. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2818–2826
  22. Szegedy C, Ioffe S, Vanhoucke V et al. (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. Thirty-First AAAI Conference on Artificial Intelligence
  23. He KM, Zhang XY, Ren SQ et al. (2016) Deep residual learning for image recognition. IEEE Conference on Computer Vision and Pattern Recognition. pp 770–778
  24. Litjens G, Kooi T, Bejnordi BE et al (2017) A survey on deep learning in medical image analysis. Med Image Anal 42(9):60–88
    Article Google Scholar
  25. Wang L, Zhang K, Liu X et al (2017) Comparative analysis of image classification methods for automatic diagnosis of ophthalmic images. Sci Rep 7(1):41545–41545
    Article Google Scholar
  26. Liu X, Jiang J, Zhang K et al. (2017) Localization and diagnosis framework for pediatric cataracts based on slit-lamp images using deep features of a convolutional neural network. PLOS ONE, 12(3)
  27. Saini JS, Jain AK, Kumar S et al (2003) Neural network approach to classify infective keratitis. Curr Eye Res 27(2):111–116
    Article Google Scholar
  28. Zhang K, Liu X, Liu F, et al. (2018) an interpretable and expandable deep learning diagnostic system for multiple ocular diseases: qualitative study. Journal of Medical Internet Research, 20(11)
  29. Kim JY, Lee HE, Choi YH et al. (2019) CNN-based diagnosis models for canine ulcerative keratitis. Scientific Reports, 9(1)
  30. Deng L, Lyu J, Huang H et al (2020) The SUSTech-SYSU dataset for automatically segmenting and classifying corneal ulcers. Scientific Data 7(1):1–7
    Article Google Scholar
  31. Qiu Q, Liu Z, Zhao Y, et al. (2016) Automatic detecting cornea fungi based on texture analysis. IEEE International Conference on Smart Cloud. IEEE
  32. Liu Z, Cao Y, Li Y, Xiao X, Qiu Q, Yang M, Zhao Y, Cui L (2020) Automatic diagnosis of fungal keratitis using data augmentation and image fusion with deep convolutional neural network. Computer Methods and Programs in Biomedicine, 187
  33. Caruana R (1997) Multitask learning. Mach Learn 28(1):41–75
    Article MathSciNet Google Scholar
  34. Gong T, Lee T, Stephenson C et al. (2019) A comparison of loss weighting strategies for multi task learning in deep neural networks. IEEE Access, PP(99):1–1

Download references

Author information

Authors and Affiliations

  1. College of Information and Communication Engineering, Harbin Engineering University, Harbin, 150001, Heilongjiang Province, China
    Qingbo Ji & Han Zhang
  2. Key Laboratory of Advanced Marine Communication and Information Technology, Ministry of Industry and Information Technology, Harbin Engineering University, Harbin, 150001, Heilongjiang Province, China
    Yue Jiang
  3. Department of Ophthalmology, Second Affiliated Hospital of Harbin Medical University, Harbin, 150086, Heilongjiang Province, China
    Lijun Qu & Qian Yang

Authors

  1. Qingbo Ji
  2. Yue Jiang
  3. Lijun Qu
  4. Qian Yang
  5. Han Zhang

Corresponding author

Correspondence toYue Jiang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

About this article

Cite this article

Ji, Q., Jiang, Y., Qu, L. et al. An Image Diagnosis Algorithm for Keratitis Based on Deep Learning.Neural Process Lett 54, 2007–2024 (2022). https://doi.org/10.1007/s11063-021-10716-2

Download citation

Keywords