Multimodal few-shot learning for plant disease detection with contrastive pre-training and query addressal (original) (raw)

References

  1. Jung M, Song JS, Shin A-Y, Choi B, Go S, Kwon S-Y, Park J, Park SG, Kim Y-M (2023) Construction of deep learning-based disease detection model in plants. Sci Rep 13(1):7331
    Article Google Scholar
  2. Zhao Y, Chen Z, Gao X, Song W, Xiong Q, Hu J, Zhang Z (2021) Plant disease detection using generated leaves based on doublegan. IEEE/ACM Trans Comput Biol Bioinf 19(3):1817–1826
    Article Google Scholar
  3. Borhani Y, Khoramdel J, Najafi E (2022) A deep learning based approach for automated plant disease classification using vision transformer. Sci Rep 12(1):11554
    Article Google Scholar
  4. Mohanty SP, Hughes DP, Salathé M (2016) Using deep learning for image-based plant disease detection. Front Plant Sci 7:215232
    Article Google Scholar
  5. Zhou J, Li J, Wang C, Wu H, Zhao C, Teng G (2021) Crop disease identification and interpretation method based on multimodal deep learning. Comput Electron Agric 189:106408
    Article Google Scholar
  6. Qiu X, Chen H, Huang P, Zhong D, Guo T, Pu C, Li Z, Liu Y, Chen J, Wang S (2023) Detection of citrus diseases in complex backgrounds based on image-text multimodal fusion and knowledge assistance. Front Plant Sci 14:1280365
    Article Google Scholar
  7. Lu Y, Lu X, Zheng L, Sun M, Chen S, Chen B, Wang T, Yang J, Lv C (2024) Application of multimodal transformer model in intelligent agricultural disease detection and question-answering systems. Plants 13(7):972
    Article Google Scholar
  8. Islam MS, Sultana S, Farid FA, Islam MN, Rashid M, Bari BS, Hashim N, Husen MN (2022) Multimodal hybrid deep learning approach to detect tomato leaf disease using attention based dilated convolution feature extractor with logistic regression classification. Sensors 22(16):6079
    Article Google Scholar
  9. Rezaei M, Diepeveen D, Laga H, Jones MG, Sohel F (2024) Plant disease recognition in a low data scenario using few-shot learning. Comput Electron Agric 219:108812
    Article Google Scholar
  10. Wang Y, Wang S (2021) Imal: an improved meta-learning approach for few-shot classification of plant diseases. In: 2021 IEEE 21st international conference on bioinformatics and bioengineering (BIBE). IEEE, pp 1–7
  11. Egusquiza I, Picon A, Irusta U, Bereciartua-Perez A, Eggers T, Klukas C, Aramendi E, Navarra-Mestre R (2022) Analysis of few-shot techniques for fungal plant disease classification and evaluation of clustering capabilities over real datasets. Front Plant Sci 13:813237
    Article Google Scholar
  12. Koch G, Zemel R, Salakhutdinov R (2015) Siamese neural networks for one-shot image recognition. In: ICML deep learning workshop, vol 2. Lille, pp 1–30
  13. Jadon S (2020) SSM-Net for plants disease identification in low data regime. In: 2020 IEEE/ITU international conference on artificial intelligence for good (AI4G). IEEE, pp 158–163
  14. Goncharov P, Uzhinskiy A, Ososkov G, Nechaevskiy A, Zudikhina J (2020) Deep Siamese networks for plant disease detection. In: EPJ web of conferences, vol 226. EDP Sciences, p 03010
  15. Argüeso D, Picon A, Irusta U, Medela A, San-Emeterio MG, Bereciartua A, Alvarez-Gila A (2020) Few-shot learning approach for plant disease classification using images taken in the field. Comput Electron Agric 175:105542
    Article Google Scholar
  16. Saad MH, Salman AE (2023) A plant disease classification using one-shot learning technique with field images. Multimed Tools Appl 83:1–26
    Article Google Scholar
  17. Chen L, Cui X, Li W (2021) Meta-learning for few-shot plant disease detection. Foods 10(10):2441
    Article Google Scholar
  18. Li Y, Chao X (2021) Semi-supervised few-shot learning approach for plant diseases recognition. Plant Methods 17:1–10
    Article Google Scholar
  19. University TNA. TNAU official website (n.d.). https://tnau.ac.in. Accessed 25 Feb 2024
  20. Sennrich R, Haddow B, Birch A (2016) Improving neural machine translation models with monolingual data. In: Erk K, Smith NA (eds) Proceedings of the 54th annual meeting of the Association for Computational Linguistics (volume 1: long papers). Association for Computational Linguistics, Berlin, Germany, pp 86–96
  21. Wolf T, Debut L, Sanh V, Chaumond J, Delangue C, Moi A, Cistac P, Rault T, Louf R, Funtowicz M, Davison J, Shleifer S, Platen P, Ma C, Jernite Y, Plu J, Xu C, Le Scao T, Gugger S, Drame M, Lhoest Q, Rush A (2020) Transformers: state-of-the-art natural language processing. In: Liu Q, Schlangen D (eds) Proceedings of the 2020 conference on empirical methods in natural language processing: system demonstrations. Association for Computational Linguistics, pp 38–45
  22. Liu H, Li C, Wu Q, Lee YJ (2024) Visual instruction tuning. In: Advances in neural information processing systems, vol 36
  23. Nguyen T, Gadre SY, Ilharco G, Oh S, Schmidt L (2024) Improving multimodal datasets with image captioning. In: Advances in neural information processing systems, vol 36
  24. Agriculture PU. Vegetable disease photos (n.d.). https://ag.purdue.edu/department/arge/swpap/veg-disease-photos.html. Accessed 29 Jan 2025
  25. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR), pp 770–778
  26. Devlin J, Chang M-W, Lee K, Toutanova K (2019) BERT: pre-training of deep bidirectional transformers for language understanding. In: Burstein J, Doran C, Solorio T (eds) Proceedings of the 2019 conference of the North American Chapter of the Association for Computational Linguistics: human language technologies, volume 1 (long and short papers). Association for Computational Linguistics, Minneapolis, Minnesota, pp 4171–4186
  27. Xing EP, Ng AY, Jordan MI, Russell S (2002) Distance metric learning, with application to clustering with side-information. In: Proceedings of the 16th international conference on neural information processing systems. NIPS’02. MIT Press, Cambridge, MA, pp 521–528
  28. Hospedales T, Antoniou A, Micaelli P, Storkey A (2022) Meta-learning in neural networks: a survey. IEEE Trans Pattern Anal Mach Intell 44(09):5149–5169
    Google Scholar
  29. Snell J, Swersky K, Zemel R (2017) Prototypical networks for few-shot learning. In: NIPS’17. Curran Associates Inc., Red Hook, NY, pp 4080–4090
  30. Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980
  31. Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP (2002) Smote: synthetic minority over-sampling technique. J Artif Intell Res 16:321–357
    Article Google Scholar
  32. Mukti IZ, Biswas D (2019) Transfer learning based plant diseases detection using resnet50. In: 2019 4th international conference on electrical information and communication technology (EICT). IEEE, pp 1–6
  33. Wang B, Wang D (2019) Plant leaves classification: a few-shot learning method based on Siamese network. IEEE Access 7:151754–151763
    Article Google Scholar

Download references