Lite Transformer Network with Long–Short Range Attention for Real-Time Fire Detection (original) (raw)

Abstract

With the popularity of video surveillance network, image-based fire detection method is of great significance to reduce the loss of public life and public property caused by fire disasters. Convolutional neural networks based on deep learning have been used in the field of fire detection. However, these methods directly use the existing object detection network, so there are some problems such as low detection accuracy, slow speed and high calculation cost. In this paper, we propose a cost-efficient neural network based on long-short range attention for real-time fire detection. First, we design a light-weight backbone network to extract multi-scale fire features with lower computational cost. Secondly, we introduce the transformer module into the convolution layer and construct an long-short range attention block, which can extract the global attention independent of distance to assist the network in identifying fire and background. Finally, the feature fusion module is constructed to process the multi-scale features extracted by backbone, and improve the detection effect of different size fires, especially early small-size fires. The experimental results show that our network can accurately detect fire with very fast speed and very low calculation cost, and the false alarm rate is lower. At the same time, it also has significant advantages for the detection performance of early small-size fire.

Access this article

Log in via an institution

Subscribe and save

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Data Availability

The data presented in this study are available on request from the corresponding author.

Code Availability

The code presented in this study are available on request from the corresponding author.

References

  1. Zhang J, Li W, Han N, Kan J (2008) Forest fire detection system based on a zigbee wireless sensor network. Front Forest China 3(3):369–374
    Article Google Scholar
  2. Aslan YE, Korpeoglu I, Ulusoy Ö (2012) A framework for use of wireless sensor networks in forest fire detection and monitoring. Comput Environ Urban Sys 36(6):614–625 (2012)
    Article Google Scholar
  3. Dener M, Özkök Y, Bostancıoğlu C (2015) Fire detection systems in wireless sensor networks. Procedia Soc Behav Sci 195:1846–1850
    Article Google Scholar
  4. Celik T (2010) Fast and efficient method for fire detection using image processing. ETRI J 32(6):881–890
    Article Google Scholar
  5. Wang T, Shi L, Yuan P, Bu L, Hou X (2017) A new fire detection method based on flame color dispersion and similarity in consecutive frames. In: 2017 Chinese automation congress (CAC). IEEE, pp. 151–156
  6. Emmy Prema C, Vinsley S, Suresh S (2018) Efficient flame detection based on static and dynamic texture analysis in forest fire detection. Fire technology 54(1):255–288
    Article Google Scholar
  7. Abdusalomov A, Baratov N, Kutlimuratov A, Whangbo TK (2021) An improvement of the fire detection and classification method using yolov3 for surveillance systems. Sensors 21(19): 6519
    Article Google Scholar
  8. Majid S, Alenezi F, Masood S, Ahmad M, Gündüz E, Polat K (2022) Attention based CNN model for fire detection and localization in real-world images. Expert Syst App 189:116114
    Article Google Scholar
  9. Xu R, Lin H, Lu K, Cao L, Liu Y (2021) A forest fire detection system based on ensemble learning. Forests 12(2):217
    Article Google Scholar
  10. Kim B, Lee J (2019) A video-based fire detection using deep learning models. Appl Sci 9(14):2862
    Article Google Scholar
  11. Jadon A, Omama M, Varshney A, Ansari MS, Sharma R (2019) Firenet: a specialized lightweight fire & smoke detection model for real-time IoT applications. arXiv preprint arXiv:1905.11922
  12. Luo Y, Zhao L, Liu P, Huang D (2018) Fire smoke detection algorithm based on motion characteristic and convolutional neural networks. Multimedia Tools App 77(12):15075–15092
    Article Google Scholar
  13. Govil EA (2020) Kinshuk: Preliminary results from a wildfire detection system using deep learning on remote camera images. Remote Sens
  14. Bochkovskiy A, Wang C-Y, Liao H-YM (2020) Yolov4: optimal speed and accuracy of object detection. arXiv preprint arXiv:2004.10934
  15. Ren S, He K, Girshick R, Sun J (2015) Faster R-CNN: towards real-time object detection with region proposal networks. Adv Neural Inf Process Syst 28
  16. Guede EA (2021) Federico: a deep learning based object identification system for forest fire detection. Fire
  17. Tan M, Le Q (2019) Efficientnet: rethinking model scaling for convolutional neural networks. In: International conference on machine learning. PMLR, pp. 6105–6114
  18. Selvaraju RR, Das A, Vedantam R, Cogswell M, Parikh D, Batra D (2016) Grad-cam: why did you say that? arXiv preprint arXiv:1611.07450
  19. Tan M, Pang R, Le QV (2020) Efficientdet: scalable and efficient object detection. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 10781–10790
  20. Li P, Zhao W (2020) Image fire detection algorithms based on convolutional neural networks. Case Stud Therm Eng 19:100625
    Article Google Scholar
  21. Wu Z, Liu Z, Lin J, Lin Y, Han S (2020) Lite transformer with long-short range attention. arXiv preprint arXiv:2004.11886
  22. Dimitropoulos K, Barmpoutis P, Grammalidis N (2014) Spatio-temporal flame modeling and dynamic texture analysis for automatic video-based fire detection. IEEE Trans Circ Syst Video Technol 25(2):339–351
    Article Google Scholar
  23. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556
  24. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770–778
  25. Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 779–788
  26. Redmon J, Farhadi A (2017) Yolo9000: better, faster, stronger. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 7263–7271
  27. Redmon J, Farhadi A (2018) Yolov3: an incremental improvement. arXiv preprint arXiv:1804.02767
  28. Sandler M, Howard A, Zhu M, Zhmoginov A, Chen L-C (2018) Mobilenetv2: inverted residuals and linear bottlenecks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 4510–4520
  29. Li Z, Zou H, Sun X, Zhu T, Ni C (2021) 3d expression-invariant face verification based on transfer learning and Siamese network for small sample size. Electronics 10(17), 2128
    Article Google Scholar
  30. Fukui H, Hirakawa T, Yamashita T, Fujiyoshi H (2019) Attention branch network: learning of attention mechanism for visual explanation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 10705–10714
  31. Woo S, Park J, Lee J-Y, Kweon IS (2018) Cbam: convolutional block attention module. In: Proceedings of the European conference on computer vision (ECCV), pp. 3–19
  32. Zhang H-J, Zhang N, Xiao N-F (2015) Fire detection and identification method based on visual attention mechanism. Optik 126(24):5011–5018
    Article Google Scholar
  33. Lee SH, Lee S, Song BC (2021) Vision transformer for small-size datasets. arXiv preprint arXiv:2112.13492
  34. Mehta S, Rastegari M (2021) Mobilevit: light-weight, general-purpose, and mobile-friendly vision transformer. arXiv preprint arXiv:2110.02178
  35. Lin T-Y, Dollár P, Girshick R, He K, Hariharan B, Belongie, S (2017) Feature pyramid networks for object detection. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, pp. 2117–2125
  36. Wang K, Liew JH, Zou Y, Zhou D, Feng J (2019) Panet: few-shot image semantic segmentation with prototype alignment. In: Proceedings of the IEEE/CVF international conference on computer vision, pp. 9197–9206
  37. Loshchilov I, Hutter F (2016) SGDR: stochastic gradient descent with warm restarts. arXiv preprint arXiv:1608.03983
  38. Tian Z, Shen C, Chen H, He T (2019) Fcos: fully convolutional one-stage object detection. In: Proceedings of the IEEE/CVF international conference on computer vision, pp. 9627–9636
  39. Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu C-Y, Berg AC (2016) SSD: single shot multibox detector. In: European conference on computer vision. Springer, pp. 21–37
  40. Pan H, Badawi D, Cetin AE (2021) Computationally efficient wildfire detection method using a deep convolutional network pruned via Fourier analysis. Sensors

Download references

Funding

Funded by National Natural Science Foundation of China.

Author information

Author notes

  1. Zhai Yaqin, Zheng Zhaoxiang, and Li Ao have contributed equally to this work.

Authors and Affiliations

  1. College of Mechanical and Electronic Engineering, Nanjing Forestry University, Longpan Road, Nanjing, 210037, Jiangsu, China
    Zhao Wenxuan, Zhao Yaqin, Zheng Zhaoxiang & Li Ao

Authors

  1. Zhao Wenxuan
  2. Zhao Yaqin
  3. Zheng Zhaoxiang
  4. Li Ao

Corresponding author

Correspondence toZhao Yaqin.

Ethics declarations

Conflict of interest

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Cite this article

Wenxuan, Z., Yaqin, Z., Zhaoxiang, Z. et al. Lite Transformer Network with Long–Short Range Attention for Real-Time Fire Detection.Fire Technol 59, 3231–3253 (2023). https://doi.org/10.1007/s10694-023-01465-w

Download citation

Keywords