Medical image fusion based on saliency and adaptive similarity judgment (original) (raw)

Abstract

Information regarding single-modality medical images remains limited at present. Therefore, the details of relevant organizations cannot be reflected by such information and misdiagnosis may result in the clinical setting. A novel image fusion method based on nonsubsampled contourlet transform (NSCT) and visual saliency is presented for multimode medical images to solve the aforementioned problem and improve the effect of fused images. In this method, an image is initially decomposed via NSCT to obtain low- and high-frequency coefficients and derive the Achanta (AC) saliency map of the image. Subsequently, the similarity of low- and high-frequency subbands is calculated using the standard deviation and energy of a region. Similarity is determined through an adaptive threshold. Meanwhile, the saliency map is utilized to guide the fusion of high- and low-frequency coefficients, with emphasis on the visual salient target area of the source image. Lastly, inverse NSCT is used to reconstruct the fused image. The proposed algorithm can effectively improve the quality of multimodal medical image fusion and increase complementary information among different modalities as demonstrated by the experimental results. This algorithm is superior to existing medical image fusion algorithms and more in accord with human visual characters.

Access this article

Log in via an institution

Subscribe and save

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Zhang F, Yoo Y, Mong K et al (2007) Non linear diffusion in Laplacian pyramid domain for ultrasonic speckle reduction. IEEE Trans Med Imaging 26(2):200–211
    Article Google Scholar
  2. Li S, Kang X, Fang L (2017) Pixel-level image fusion: a survey of the state of the art. Inform Fusion 33:100–112
    Article Google Scholar
  3. Yin H (2015) Sparse representation with learned multiscale dictionary for image fusion. Neurocomputing 148(19):600–610
    Article Google Scholar
  4. Xiao B, Wang K, Bi X, Li W, Han J (2018) 2D-LBP: an enhanced local binary feature for texture image classification, IEEE Trans Circuits Syst Video Technol. https://doi.org/10.1109/TCSVT.2018.2869841
  5. Cai K, Yang RQ, Li LH et al (2016) Tetralogy of Fallot cardiac function evaluation and intelligent diagnosis based on dual-source computed tomography cardiac images. Artif Organs 5(40):459–469
    Article Google Scholar
  6. Cai K, Yang RQ, Yue HW et al (2017) Dynamic updating atlas for heart segmentation with a nonlinear field-based model. Int J Med Rob Comput Assisted Surg 3(13):e1785
    Article Google Scholar
  7. Burt P, Adelson E (1983) The Laplacian pyramid as a compact image code. IEEE Trans Comput 31(4):532–540
    Google Scholar
  8. Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20(11):1254–1259
    Article Google Scholar
  9. Cai W, Chen S, Zhang D (2007) Fast and robust fuzzy c-means clustering algorithms incorporating local information for image segmentation. Pattern Recogn 40(3):835–838
    Article Google Scholar
  10. Hou X, Zhang L (2007) Saliency detection: a spectral residual approach. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp.1-8
  11. Cunha A, Jianping Z, Do M (2006) The nonsubsampled contourlet transform: theory, design, and applications. IEEE Trans Image Process, Publ IEEE Signal Process Soc 15(10):3089–3101
    Article Google Scholar
  12. Achanta R, Hemami S, Estrada F (2009) Frequency-tuned salient region detection. Proceedings of the Computer Vision and Pattern Recognition, Los Alamitos: IEEE Computer Society Press, pp.1597-1604
  13. Wei X, Lin H, Yu Y, Yang L (2017) Low-resource cross-domain product review sentiment classification based on a CNN with an auxiliary large-scale corpus. Algorithms 10(3):81–90
    Article Google Scholar
  14. Cai K, Yang RQ, Li LH et al (2015) A semi-automatic coronary artery segmentation framework using mechanical simulation. Journal Med Syst 10(39):65–74
    Google Scholar
  15. Cai K, Yang RQ, Chen HZ et al (2017) A framework combining window width-level adjustment and Gaussian filter-based multi-resolution for automatic whole heart segmentation. Neurocomputing 1(220):138–150
    Article Google Scholar
  16. Liu Y, Wang Z (2014) Simultaneous image fusion and denoising with adaptive sparse representation. IET Image Process 9(5):347–357
    Article Google Scholar
  17. Wei W, Song H, Li W, Shen P, Vasilakos A (2017) Gradient-driven parking navigation using a continuous information potential field based on wireless sensor network. Inf Sci 408(2):100–114
    Article Google Scholar
  18. Kim M, Han DK (2016) Joint patch clustering-based dictionary learning for multimodal image fusion. Inform Fusion 27:198–214
    Article Google Scholar
  19. Chen H, Qiao H, Xu L, Feng Q, Cai K (2019) A fuzzy optimization strategy for the implementation of RBF LSSVR model in Vis-NIR analysis of pomelo maturity. IEEE Trans Ind Inf:1. https://doi.org/10.1109/TII.2019.2933582
  20. Song HB, He DJ, Gong L (2014) Crops image fusion in different light conditions based on contourlet transform. Trans Chinese Soc Agric Eng 30(11):173–179
    Google Scholar
  21. Huang Z, Tang J, Shan G, Ni J, Chen Y, Wang C (2019) An efficient passenger-hunting recommendation framework with multi-task deep learning. IEEE Internet Things J. https://doi.org/10.1109/JIOT.2019.2901759
  22. Cai ZS, Chen MS (2015) Study on multi-focus image fusion method based on wavelet transfrom. Laser Optoelectron Prog 52:091003
    Article Google Scholar
  23. Hu XL, Pan DW, Lu HM (2012) Image fusion based on the second generation curvelet transform and feature product. Microelectron Comput 29(11):126–129
    Google Scholar
  24. Huang ZY, He JN (2017) A novel image fusion algorithm based on NSCT and regional features. J Fuzhou Univ 45(1):80–90
    Google Scholar
  25. Li S, Fang L, Yin H (2012) Multitemporal image change detection using a detail-enhancing approach with nonsubsampled contourlet transform. IEEE Geosci Remote Sens Lett 9(5):836–840
    Article Google Scholar
  26. Dai WZ, Pan SW, Li JF (2017) Medical image fusion algorithm based on human visual characteristics and adaptive PCNN. J Optoelectron Laser 7:808–816
    Google Scholar
  27. Su J, Li B, Wang YZ (2016) Infrared image enhancement based on PCNN segmentation and fuzzy set theory. Acta Opt Sin 36(9):0910001
    Article Google Scholar
  28. Palmedo H, Bucerius J, Joe A (2006) Integrated PET /CT in differentiated thyroid cancer: diagnostic accuracy and impact on patient management. J Nucl Med 47(4):616–624
    Google Scholar
  29. Zhang M, Zhang D, Goerlandt F, Yan X, Kujala P (2019) Use of HFACS and fault tree model for collision risk factors analysis of icebreaker assistance in ice-covered waters. Saf Sci 111:128–143
    Article Google Scholar
  30. Wei W, Fan X, Song H, Fan X, Yang J (2016) Imperfect information dynamic Stackelberg game based resource allocation using hidden Markov for cloud computing. IEEE Trans Serv Comput 11(1):78–89
    Article Google Scholar

Download references

Funding

This work was supported by the China Postdoctoral Science Foundation (No.2018T110880, No. 2017M620375) and Guangdong Provincial Science and Technology Program (No. 2017A040405056).

Author information

Authors and Affiliations

  1. College of Automation, Zhongkai University of Agriculture and Engineering, Guangzhou, 510225, China
    Wei Li, Keqiang Wang & Ken Cai

Authors

  1. Wei Li
  2. Keqiang Wang
  3. Ken Cai

Corresponding author

Correspondence toKen Cai.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

About this article

Cite this article

Li, W., Wang, K. & Cai, K. Medical image fusion based on saliency and adaptive similarity judgment.Pers Ubiquit Comput 27, 2019–2025 (2023). https://doi.org/10.1007/s00779-019-01317-x

Download citation

Keywords