RDLR: A Robust Deep Learning-Based Image Registration Method for Pediatric Retinal Images (original) (raw)

References

  1. Ripley, D.L. & Politzer, T. Vision disturbance after TBI. NeuroRehabilitation 27, 215-216 (2010).
    PubMed Google Scholar
  2. Fox, S.M., Koons, P. & Dang, S.H. Vision Rehabilitation After Traumatic Brain Injury. Phys Med Rehabil Clin N Am 30, 171-188 (2019).
    Article PubMed Google Scholar
  3. Blindness, G.B.D., Vision Impairment, C. & Vision Loss Expert Group of the Global Burden of Disease, S. Trends in prevalence of blindness and distance and near vision impairment over 30 years: an analysis for the Global Burden of Disease Study. Lancet Glob Health 9, e130-e143 (2021).
  4. Liu, D., Zheng, J. & Lu, Y. Fundus Examination of 23,861 Newborns by Digital Imaging in Ningbo. J Ophthalmol 2021, 6620412 (2021).
    Article PubMed PubMed Central Google Scholar
  5. Gundlach, B.S., et al. Real-world visual outcomes of laser and anti-VEGF treatments for retinopathy of prematurity. Am J Ophthalmol (2021).
  6. Munson, M.C., et al. Autonomous early detection of eye disease in childhood photographs. Sci Adv 5, eaax6363 (2019).
  7. Yan, H.X., et al. Analysis of fundus examination results in 8 808 pediatric patients in Northwest China. Zhonghua Yan Ke Za Zhi 57, 777-783 (2021).
    CAS PubMed Google Scholar
  8. RetCam - a useful adjunctive tool to evaluate and manage paediatric glaucomas. Asian Journal of Ophthalmology (2008).
  9. Park, J.W., Park, S.W. & Heo, H. RetCam image analysis of the optic disc in premature infants. Eye (Lond) 27, 1137-1141 (2013).
    Article CAS PubMed Google Scholar
  10. Vinekar, A., et al. Universal ocular screening of 1021 term infants using wide-field digital imaging in a single public hospital in India - a pilot study. Acta Ophthalmol 93, e372-376 (2015).
    Article PubMed Google Scholar
  11. Mayro, E.L., Wang, M., Elze, T. & Pasquale, L.R. The impact of artificial intelligence in the diagnosis and management of glaucoma. Eye (Lond) 34, 1-11 (2020).
    Article PubMed Google Scholar
  12. L PINELLO, M.M. Use of wide field digital retinal imaging (RET CAM II) in paediatric retinal diseases. Acta Ophthalmol 90(2012).
  13. Karp, K.A., et al. Training retinal imagers for retinopathy of prematurity (ROP) screening. J AAPOS 20, 214-219 (2016).
    Article PubMed PubMed Central Google Scholar
  14. Fielder, A.R., et al. Describing Retinopathy of Prematurity: Current Limitations and New Challenges. Ophthalmology 126, 652-654 (2019).
    Article PubMed Google Scholar
  15. Chiang, M.F., et al. International Classification of Retinopathy of Prematurity, Third Edition. Ophthalmology 128, e51-e68 (2021).
    PubMed Google Scholar
  16. Campbell, J.P., et al. Artificial Intelligence for Retinopathy of Prematurity: Validation of a Vascular Severity Scale against International Expert Diagnosis. Ophthalmology (2022).
  17. Gschliesser, A., et al. Inter-expert and intra-expert agreement on the diagnosis and treatment of retinopathy of prematurity. Am J Ophthalmol 160, 553–560 e553 (2015).
  18. Bolon-Canedo, V., et al. Dealing with inter-expert variability in retinopathy of prematurity: A machine learning approach. Comput Methods Programs Biomed 122, 1-15 (2015).
    Article CAS PubMed PubMed Central Google Scholar
  19. Chan-Ling, T., Gole, G.A., Quinn, G.E., Adamson, S.J. & Darlow, B.A. Pathophysiology, screening and treatment of ROP: A multi-disciplinary perspective. Prog Retin Eye Res 62, 77-119 (2018).
    Article CAS PubMed Google Scholar
  20. Herbert Bay, T.T., and Luc Van Gool. SURF: Speeded Up Robust Features. (2006).
  21. Bay, H., Ess, A., Tuytelaars, T., Van Gool, L. Speeded-Up Robust Features (SURF). Computer Vision and Image Understanding 110(2008).
  22. Herrmann, C., et al. Robust Image Stitching with Multiple Registrations. Computer Vision - Eccv 2018, Pt Ii 11206, 53–69 (2018).
  23. Schlagenhauf, T., Brander, T. & Fleischer, J. A stitching algorithm for automated surface inspection of rotationally symmetric components. Cirp Journal of Manufacturing Science and Technology 35, 169-177 (2021).
    Article Google Scholar
  24. Kerkech, M., Hafiane, A. & Canals, R. Vine disease detection in UAV multispectral images using optimized image registration and deep learning segmentation approach. Comput Electron Agr 174(2020).
  25. MiroslavTrajković, M. Fast corner detection. Image and Vision Computing 16(1998).
  26. Parkhomenko, P.M.A. Affine Transformations. Euclidean and Affine Transformations (1965).
  27. Fischler, M.A. & Bolles, R.C. Random sample consensus. Communications of the ACM 24, 381-395 (1981).
    Article Google Scholar
  28. Ting, D.S.W., et al. Deep learning in ophthalmology: The technical and clinical considerations. Prog Retin Eye Res 72, 100759 (2019).
    Article PubMed Google Scholar
  29. Balakrishnan, G., Zhao, A., Sabuncu, M.R., Guttag, J. & Dalca, A.V. VoxelMorph: A Learning Framework for Deformable Medical Image Registration. IEEE Trans Med Imaging (2019).
  30. Li, Y., Chen, C., Yang, F. & Huang, J. Hierarchical Sparse Representation for Robust Image Registration. IEEE Trans Pattern Anal Mach Intell 40, 2151-2164 (2018).
    Article PubMed Google Scholar
  31. Chang, X., Du, S., Li, Y. & Fang, S. A Coarse-to-Fine Geometric Scale-Invariant Feature Transform for Large Size High Resolution Satellite Image Registration. Sensors (Basel) 18(2018).
  32. Liu, R., et al. Learning Deformable Image Registration from Optimization: Perspective, Modules, Bilevel Training and Beyond. IEEE Trans Pattern Anal Mach Intell PP(2021).
  33. Qu, L., et al. Cross-modal coherent registration of whole mouse brains. Nat Methods 19, 111-118 (2022).
    Article CAS PubMed Google Scholar
  34. Li, A., Guo, J. & Guo, Y. Image Stitching Based on Semantic Planar Region Consensus. IEEE Trans Image Process 30, 5545-5558 (2021).
    Article PubMed Google Scholar
  35. Haskins, G., Kruger, U. & Yan, P. Deep learning in medical image registration: a survey. Machine Vision and Applications 31(2020).
  36. Abbasi, S., et al. Medical image registration using unsupervised deep neural network: A scoping literature review. Biomedical Signal Processing and Control 73(2022).
  37. Han, R., et al. Deformable MR-CT image registration using an unsupervised, dual-channel network for neurosurgical guidance. Med Image Anal 75, 102292 (2022).
    Article CAS PubMed Google Scholar
  38. Nie, L., Lin, C., Liao, K., Liu, S. & Zhao, Y. Unsupervised Deep Image Stitching: Reconstructing Stitched Features to Images. IEEE Trans Image Process PP(2021).
  39. Hering, A., et al. CNN-based lung CT registration with multiple anatomical constraints. Med Image Anal 72, 102139 (2021).
    Article PubMed PubMed Central Google Scholar
  40. Fan, J., Cao, X., Yap, P.T. & Shen, D. BIRNet: Brain image registration using dual-supervised fully convolutional networks. Med Image Anal 54, 193-206 (2019).
    Article PubMed PubMed Central Google Scholar
  41. Nie, L., Lin, C., Liao, K., Liu, M. & Zhao, Y. A view-free image stitching network based on global homography. Journal of Visual Communication and Image Representation 73(2020).
  42. Krishnan, R., Rajpurkar, P. & Topol, E.J. Self-supervised learning in medicine and healthcare. Nat Biomed Eng (2022).
  43. Shen, X., et al. GIM: Learning Generalizable Image Matcher From Internet Videos. in The Twelfth International Conference on Learning Representations (2023).
  44. Lowe, D.G. Distinctive Image Features from Scale-Invariant Keypoints. International Journal of Computer Vision 60, 91-110 (2004).
    Article Google Scholar
  45. Rublee, E., Rabaud, V., Konolige, K. & Bradski, G.R. ORB: an efficient alternative to SIFT or SURF. in IEEE International Conference on Computer Vision, ICCV 2011, Barcelona, Spain, November 6–13, 2011 (2011).
  46. Zhang, H., Jia, N., Zhuo, K. & Zhao, W. Retinal fundus image registration framework using Bayesian integration and asymmetric Gaussian mixture model. International Journal of Imaging Systems and Technology 33, 403-418 (2023).
    Article Google Scholar
  47. Bian, J., et al. GMS: Grid-Based Motion Statistics for Fast, Ultra-Robust Feature Correspondence. in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2828–2837 (2017).
  48. Yi, K.M., Trulls, E., Lepetit, V. & Fua, P. LIFT: Learned Invariant Feature Transform. Springer International Publishing (2016).
    Google Scholar
  49. Rivas-Villar, D., Hervella, Á.S., Rouco, J. & Novo, J. Joint keypoint detection and description network for color fundus image registration. Quantitative Imaging in Medicine and Surgery 13, 4540 (2023).
    Article PubMed PubMed Central Google Scholar
  50. Xu, J., et al. Reliable and stable fundus image registration based on brain-inspired spatially-varying adaptive pyramid context aggregation network. Frontiers in Neuroscience 16, 1117134 (2023).
    Article PubMed PubMed Central Google Scholar
  51. Kim, J., et al. Fundus Image Translation with Scale-Aware Registration and Gradient-Guided GAN. Available at SSRN 4700915.
  52. Rivas-Villar, D., Hervella, Á.S., Rouco, J. & Novo, J. Color fundus image registration using a learning-based domain-specific landmark detection methodology. Computers in Biology and Medicine 140(2022).
  53. Mok, T.C.W. & Chung, A.C.S. Fast Symmetric Diffeomorphic Image Registration with Convolutional Neural Networks. in IEEE/CVF Conference on Computer Vision and Pattern Recognition (2020).
  54. Martínez-Río, J., Carmona, E.J., Cancelas, D., Novo, J. & Ortega, M. Deformable registration of multimodal retinal images using a weakly supervised deep learning approach. Neural Computing and Applications 35, 14779-14797 (2023).
    Article Google Scholar
  55. Nguyen, T., Chen, S.W., Shivakumar, S.S., Taylor, C.J. & Kumar, V. Unsupervised Deep Homography: A Fast and Robust Homography Estimation Model. Ieee Robotics and Automation Letters 3, 2346-2353 (2018).
    Article Google Scholar
  56. Nianjin Ye, C.W., Shuaicheng Liu, Lanpeng Jia, Jue Wang, Yongqing Cui. DeepMeshFlow: Content Adaptive Mesh Deformation for Robust Image Registration. arXiv (2019).
  57. Ochoa-Astorga, J.E., Wang, L., Du, W. & Peng, Y. A Straightforward Bifurcation Pattern-Based Fundus Image Registration Method. Sensors 23, 7809 (2023).
    Article PubMed PubMed Central Google Scholar
  58. Wang, C.-Y., et al. MEMO: dataset and methods for robust multimodal retinal image registration with large or small vessel density differences. Biomedical Optics Express 15, 3457-3479 (2024).
    Article PubMed PubMed Central Google Scholar
  59. Land, C.E. An evaluation of approximate confidence interval estimation methods for lognormal means. Technometrics 14, 145-158 (1972).
    Article Google Scholar

Download references