Colorizing Images with Split-Brain Autoencoders and Convolutional Neural Networks (original) (raw)

Abstract

This research presents a novel methodology for image colorization using the architecture of Split-Brain Autoencoders (SBAE) with Convolutional Neural Networks (CNNs) in the Caffe framework for predicting missing colors in grayscale images. Image Colorization has been an ongoing research topic in computer vision for many years as this is a strenuous task due to the high dimensionality of the color space, the variability of color perception, and the ambiguity of the grayscale images. Our model processes only the ‘A’, ‘B’ color channels from the LAB color-space and combining the channels at the end of the model to generate the output color image reducing the computational overhead and improving efficiency. The proposed deep learning model is trained on ImageNet dataset and evaluated on standard benchmark datasets. Our results reveal that the suggested method has significant improvements in accuracy and visual quality, achieving higher PSNR and SSIM values over prevailing methods.

References

  1. Žeger, I., Grgic, S., Vuković, J., Šišul, G.: Grayscale image colorization methods: overview and evaluation. IEEE Access 9, 113326–113346 (2021)
    Article Google Scholar
  2. Khan, M.U.G., Gotoh, Y., Nida, N.: Medical image colorization for better visualization and segmentation. In: Medical Image Understanding and Analysis: 21st Annual Conference, MIUA 2017, Edinburgh, UK, July 11–13, 2017, Proceedings 21, pp. 571–580. Springer, Cham (2017)
    Google Scholar
  3. Xu, M., Ding, Y.: Fully automatic image colorization based on semantic segmentation technology. PLoS ONE 16(11), e0259953 (2021)
    Article CAS PubMed PubMed Central Google Scholar
  4. Yagoub, B., Ibrahem, H., Salem, A., Kang, H.-S.: Single energy X-ray image colorization using convolutional neural network for material discrimination. Electronics 11(24), 4101 (2022). https://doi.org/10.3390/electronics11244101
    Article Google Scholar
  5. Mietzner, R., Unger, T., Leymann, F.: Cafe: a generic configurable customizable composite cloud application framework. In: OTM Confederated International Conferences “On the Move to Meaningful Internet Systems”, pp. 357–364. Springer, Berlin, Heidelberg (2009)
    Google Scholar
  6. Nguyen, T., Mori, K., Thawonmas, R.: Image colorization using a deep convolutional neural network. arXiv preprint arXiv:1604.07904 (2016)
    Google Scholar
  7. Larsson, G., Maire, M., Shakhnarovich, G.: Learning representations for automatic colorization. In: ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part IV, pp. 577–593. Springer, Cham (2016)
    Google Scholar
  8. Nazeri, K., Ng, E., Ebrahimi, M.: Image colorization using generative adversarial networks. In: AMDO 2018: 10th International Conference, Palma de Mallorca, Spain, July 12-13, 2018, Proceedings, pp. 85–94. Springer, Cham (2018)
    Google Scholar
  9. Zhang, R., Isola, P., Efros, A.A.: Split-brain autoencoders: Unsupervised learning by cross-channel prediction. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1058–1067 (2017)
    Google Scholar
  10. Stojnić, V., Risojević, V.: Analysis of color space quantization in split-brain autoencoder for remote sensing image classification. In: 14th Symposium on Neural Networks and Applications (NEUREL), pp. 1–4. IEEE (2018)
    Google Scholar
  11. Zhang, R., Isola, P., Efros, A.A.: Colorful image colorization. In: ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part III, pp. 649–666. Springer, Cham (2016)
    Google Scholar
  12. Iizuka, S., Simo-Serra, E., Ishikawa, H.: Let there be color! joint end-to-end learning of global and local image priors for automatic image colorization with simultaneous classification. ACM Trans. Graph. 35(4), 1–11 (2016)
    Article Google Scholar
  13. Sara, U., Akter, M., Uddin, M.S.: Image quality assessment through FSIM, SSIM, MSE, and PSNR—a comparative study. J. Comp. Communt. 7(3), 8–18 (2019)
    Article Google Scholar
  14. Hore, A., Ziou, D.: Image quality metrics: PSNR vs. SSIM. In: 20th International Conference on Pattern Recognition, pp. 2366–2369. IEEE (2010)
    Google Scholar
  15. Levin, A., Lischinski, D., Weiss, Y.: Colorization using optimization. ACM Trans. Graph. 23(3), 689–694 (2004)
    Article Google Scholar
  16. Zhang, R., et al.: Real-time user-guided image colorization with learned deep priors. arXiv preprint arXiv:1705.02999 (2017)
    Google Scholar
  17. Su, J.W., Chu, H.K., Huang, J.B.: Instance-aware image colorization. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7968–7977 (2020)
    Google Scholar
  18. Vitoria, P., Raad, L., Ballester, C.: Chromagan: Adversarial picture colorization with semantic class distribution. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp. 2445–2454 (2020)
    Google Scholar

Download references

Author information

Authors and Affiliations

  1. Department of Computing Technologies, Faculty of Engineering and Technology, SRM Institute of Science and Technology, Kattankulathur, Chengalpattu, Tamil Nadu, 603203, India
    B. B. S. M. Krishna, Abhishek Gupta, Kaila Jagadish Reddy & M. K. Vidhyalakshmi

Authors

  1. B. B. S. M. Krishna
  2. Abhishek Gupta
  3. Kaila Jagadish Reddy
  4. M. K. Vidhyalakshmi

Corresponding author

Correspondence toB. B. S. M. Krishna .

Editor information

Editors and Affiliations

  1. SRM Institute of Science and Technology, Chennai, Tamil Nadu, India
    Annie Uthra R.
  2. Department of Computer Technology, Anna University, Chennai, Tamil Nadu, India
    Kottilingam Kottursamy
  3. Department of Computer Technology, Anna University, Chennai, Tamil Nadu, India
    Gunasekaran Raja
  4. Manchester Metropolitan University, Manchester, UK
    Ali Kashif Bashir
  5. Department of Computer Engineering, Süleyman Demirel University, Isparta, Türkiye
    Utku Kose
  6. SRM Institute of Science and Technology, Chennai, Tamil Nadu, India
    Revathi Appavoo
  7. SRM Institute of Science and Technology, Chennai, Tamil Nadu, India
    Vimaladevi Madhivanan

Rights and permissions

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Cite this paper

Krishna, B.B.S.M., Gupta, A., Reddy, K.J., Vidhyalakshmi, M.K. (2024). Colorizing Images with Split-Brain Autoencoders and Convolutional Neural Networks. In: R., A.U., et al. Deep Sciences for Computing and Communications. IconDeepCom 2023. Communications in Computer and Information Science, vol 2176. Springer, Cham. https://doi.org/10.1007/978-3-031-68905-5\_39

Download citation

Keywords

Publish with us