Fruit recognition from images using deep learning applications (original) (raw)

Abstract

Smart imaging devices have been used at a rapid rate in the agriculture sector for the last few years. Fruit recognition and classification is noticed as one of the looming sectors in computer vision and image classification. A fruit classification may be adopted in the fruit market for consumers to determine the variety and grading of fruits. Fruit quality is a prerequisite property from a health viewpoint. Classification systems described so far are not adequate for fruit recognition and classification during accuracy and quantitative analysis. Deep learning models have the ability to extract the potential image features without using handcrafted features. In this paper, Type-II Fuzzy, TLBO (Teacher-learner based optimization), and deep learning Convolution Neural Network (CNN), Recurrent Neural Network (RNN), and Long Short-Term Memory (LSTM) applications proposed to enhance, segment, recognize and classify the fruit images. Thus, the examination of new proposals for fruit recognition and classification is worthwhile. In the present time, automatic fruit recognition and classification is though a demanding task. Deep learning is a powerful state-of-the-art approach for image classification. This task incorporates deep learning models: CNN, RNN, LSTM for classification of fruits based on chosen optimal and derived features. As preliminary arises, it has been recognized that the recommended procedure has effective accuracy and quantitative analysis results. Moreover, the comparatively high computational momentum of the proposed scheme will promote in the future.

Access this article

Log in via an institution

Subscribe and save

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Altaheri H, Alsulaiman M, Muhammad G (2019) Date fruit classification for robotic harvesting in a natural environment using deep learning, vol 7
  2. Benalia S, Cubero S, Prats-Montalbán JM, Bernardi B, Zimbalatti G, Blasco J (2016) Computer vision for automatic quality inspection of dried figs (ficus carica l.) in real-time. Comput Electron Agric 120:17–25
    Article Google Scholar
  3. Gill HS, Khehra BS (2020) Efficient image classification technique for weather degraded fruit images. IET Image Process 14(14):3463–3470
    Article Google Scholar
  4. Gill HS, Khehra BS (2021) Minimum cross entropy thresholding based apple image segmentation using teacher learner based optimization algorithm. In: 2021 International Conference on Electrical, Communication, and Computer Engineering (ICECCE), p 1–6 IEEE
  5. Gill HS, Khehra BS (2021) A novel type-ii fuzzy based fruit image enhancement technique using gaussian s-shaped and z-shaped membership functions. In: Proceedings of international conference on communication and computational technologies, p 1–9 Springer
  6. Gill HS, Khehra BS (2021) Hybrid classifier model for fruit classification. Multimedia Tools and Applications, p 1–36
  7. Gill HS, Khehra BS (2021) An integrated approach using cnn-rnn-lstm for classification of fruit images, Materials today: Proceedings
  8. Gill HS, Khehra BS, Mavi BS (2021) Fruit images visibility enhancement using type-ii fuzzy. In: 2021 IEEE International Midwest Symposium on Circuits and Systems (MWSCAS), p 549–554 IEEE
  9. Gill HS, Khehra BS, Singh A, Kaur L (2019) Teaching-learning-based optimization algorithm to minimize cross entropy for selecting multilevel threshold values. Egypt Inform J 20(1):11–25
    Article Google Scholar
  10. Gill HS, Kumar S, Chakrabarti S (2021) Fruit image segmentation using teacher-learner optimization algorithm and fuzzy entropy. SPAST Abstracts, vol 1, no. 01
  11. Guo Y, Liu Y, Bakker EM, Guo Y, Lew MS (2018) Cnn-rnn:a large-scale hierarchical image classification framework. Multimed Tools Appl 77 (8):10251–10271
    Article Google Scholar
  12. Hameed K, Chai D, Rassau A (2018) A comprehensive review of fruit and vegetable classification techniques. Image Vis Comput 80:24–44
    Article Google Scholar
  13. Hossain MS, Al-Hammadi M, Muhammad G (2018) Automatic fruit classification using deep learning for industrial applications. IEEE Trans Ind Inform 15 (2):1027–1034
    Article Google Scholar
  14. Kang H, Chen C (2020) Fast implementation of real-time fruit detection in apple orchards using deep learning. Comput Electron Agric 168:105108
    Article Google Scholar
  15. Kussul N, Lavreniuk M, Skakun S, Shelestov A (2017) Deep learning classification of land cover and crop types using remote sensing data. IEEE Geosci Remote Sens Lett 14(5):778–782
    Article Google Scholar
  16. Li C, Yang Y, Xiao L, Li Y, Zhou Y, Zhao J (2016) A novel image enhancement method using fuzzy sure entropy. Neurocomputing 215:196–211
    Article Google Scholar
  17. Lu J, Hu J, Zhao G, Mei F, Zhang C (2017) An in-field automatic wheat disease diagnosis system. Comput Electron Agric 142:369–379
    Article Google Scholar
  18. Momeny M, Jahanbakhshi A, Jafarnezhad K, Zhang YD (2020) Accurate classification of cherry fruit using deep cnn based on hybrid pooling approach. Postharvest Biol Technol 166:111204
    Article Google Scholar
  19. Nasiri A, Taheri-Garavand A, Zhang YD (2019) Image-based deep learning automated sorting of date fruit. Postharvest Bio Technol 153:133–141
    Article Google Scholar
  20. Rangarajan AK, Purushothaman R, Ramesh A (2018) Tomato crop disease classification using pre-trained deep learning algorithm. Procedia Comput Sci 133:1040–1047
    Article Google Scholar
  21. Rasti P, Nasrollahi K, Orlova O, Tamberg G, Ozcinar C, Moeslund TB, Anbarjafari G (2017) A new low-complexity patch-based image super-resolution. IET Comput Vis 11(7):567–576
    Article Google Scholar
  22. Rocha A, Hauagge DC, Wainer J, Goldenstein S (2010) Automatic fruit and vegetable classification from images. Comput Electron Agric 70(1):96–104
    Article Google Scholar
  23. Sen Abi AA, Bahbouh NM, Alkhodre AB, Aldhawi AM, Aldham FA, Aljabri MI (2020) A classification algorithm for date fruits. In: 2020 7th International Conference on Computing for Sustainable Global Development (INDIACom), p 235–239 IEEE
  24. Singh H, Khehra BS (2018) Visibility enhancement of color images using type-ii fuzzy membership function. Mod Phys Lett B 32(11):1850130
    Article MathSciNet Google Scholar
  25. Song Y, Glasbey C, Horgan G, Polder G, Dieleman J, Van der Heijden G (2014) Automatic fruit recognition and counting from multiple images. Biosyst Eng 118:203–215
    Article Google Scholar
  26. Steinbrener J, Posch K, Leitner R (2019) Hyperspectral fruit and vegetable classification using convolutional neural networks. Comput Electron Agric 162:364–372
    Article Google Scholar
  27. Teena M, Manickavasagan A, Ravikanth L, Jayas D (2014) Near infrared (nir) hyperspectral imaging to classify fungal infected date fruits. J Stored Prod Res 59:306–313
    Article Google Scholar
  28. Turkoglu M, Hanbay D, Sengur A (2019) Multi-model lstm-based convolutional neural networks for detection of apple diseases and pests. Journal of Ambient Intelligence and Humanized Computing, p 1–11
  29. Wang S, Zhang Y, Ji G, Yang J, Wu J, Wei L (2015) Fruit classification by wavelet-entropy and feedforward neural network trained by fitness-scaled chaotic abc and biogeography-based optimization. Entropy 17(8):5711–5728
    Article Google Scholar
  30. Woodford BJ, Kasabov NK, Wearing CH (1999) Fruit image analysis using wavelets. In: Proceedings of the Iconip/Anziis/Annes, vol 99, p 88–91 Citeseer
  31. Yang J, Zhao J, Lu L, Pan T, Jubair S (2020) A new improved learning algorithm for convolutional neural networks. Processes 8(3):295
    Article Google Scholar
  32. Yin Q, Zhang R, Shao X (2019) Cnn and rnn mixed model for image classification. In: MATEC Web of Conferences, vol 277 EDP Sciences
  33. Zawbaa HM, Hazman M, Abbass M, Hassanien AE (2014) Automatic fruit classification using random forest algorithm. In: 2014 14th international conference on hybrid intelligent systems, p 164–168 IEEE
  34. Zhang YD, Dong Z, Chen X, Jia W, Du S, Muhammad K, Wang SH (2019) Image based fruit category classification by 13-layer deep convolutional neural network and data augmentation. Multimed Tools Appl 78(3):3613–3632
    Article Google Scholar
  35. Zhang Y, Wu L (2012) Classification of fruits using computer vision and a multiclass support vector machine. Sensors 12(9):12489–12505
    Article Google Scholar
  36. Zhang J, Wu Q, Shen C, Zhang J, Lu J (2018) Multilabel image classification with regional latent semantic dependencies. IEEE Trans Multimed 20 (10):2801–2813
    Article Google Scholar
  37. Zhou D, Lu L, Zhao J, Wang D, Lu W, Yang J (2020) A new learning algorithm based on strengthening boundary samples for convolutional neural networks. In: MATEC Web of Conferences, vol 327, p 02004 EDP Sciences

Download references

Author information

Authors and Affiliations

  1. Bibi Sharan Kaur Khalsa College, Chamkaur Sahib, (Punjab), India
    Harmandeep Singh Gill
  2. Department of CSE, St. Joseph’s College of Engineering, Chennai, (Tamil Nadu), India
    Ganpathy Murugesan
  3. BAM khalsa College, Garhshankar, (Punjab), India
    Baljit Singh Khehra
  4. Information Technology Department, University of Cumberlands, Kentucky, USA
    Guna Sekhar Sajja
  5. Yogananda School of AI Computers and Data Science, Shoolini University, Solan, India
    Gaurav Gupta
  6. Department of Electronics and Telecommunication, College of Engineering, Pune, India
    Abhishek Bhatt

Authors

  1. Harmandeep Singh Gill
  2. Ganpathy Murugesan
  3. Baljit Singh Khehra
  4. Guna Sekhar Sajja
  5. Gaurav Gupta
  6. Abhishek Bhatt

Corresponding author

Correspondence toHarmandeep Singh Gill.

Ethics declarations

Ethics Approval

This article does not contain any studies with human participants or animals performed by any authors.

Conflict of Interests

Authors declares that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

About this article

Cite this article

Gill, H.S., Murugesan, G., Khehra, B.S. et al. Fruit recognition from images using deep learning applications.Multimed Tools Appl 81, 33269–33290 (2022). https://doi.org/10.1007/s11042-022-12868-2

Download citation

Keywords

Profiles

  1. Harmandeep Singh Gill View author profile
  2. Guna Sekhar Sajja View author profile
  3. Gaurav Gupta View author profile