Pothole Detection from an Enhanced Aerial Image Using CNN Model (original) (raw)

Abstract

The presence of potholes in road surface can cause fatal road accidents. This can even lead to mishap of vehicles and causing property damages. An automated system of detecting potholes in road surfaces becomes one of the utility services in any driver assistance system. The proposed methodology aims at providing a warning sign to the driver through driver assistance system regarding the presence of pothole along with its risk category. Based on the road surface image captured by the front camera fixed on the vehicle, the proposed convolutional neural network (CNN) model identifies and classifies the pothole. The captured image is initially enhanced to reduce the complexity load for the CNN model and to improve the accuracy of the model. The proposed model is tested and validated over 1000 sample aerial images and it classifies the images with 91.13% accuracy. The driver assistance system with this service can alert the driver with the presence of pothole.

Similar content being viewed by others

References

  1. Lakshmi, G., Sankar, V.U., Sankar, Y.S.: Image based Road distress detection. In: International Conference on Smart Generation Computing, Communication and Networking, no. SMARTGENCON51891.2021.9645864, pp. 1–6 (2021)
    Google Scholar
  2. Azri Mat Saad, K.N.T.: Identification of rut and pothole by using multirotor unmanned aerial. J. Int. Measure. Confeder. 196, 0263–2241 (2019)
    Google Scholar
  3. Zhang, C., Nateghinia, E., Miranda-Moreno, L.F., Sun, L.: Pavement distress detection using convolutional neural network (CNN): A case study in Montreal, Canada. Int. J. Transport. Sci. Technol. (2021). no. ISSN 2046-0430
    Google Scholar
  4. Egaji, O.A., Evans, G., Griffiths, M.G., Islas, G.: Real-time machine learning-based approach for pothole detection. Expert Systems with Applications 184, 115562 (2021). no. ISSN 0957-4174
    Google Scholar
  5. Wu, H., et al.: Road pothole extraction and safety evaluation by integration of point cloud and images derived from mobile mapping sensors. Advanced Engineering Informatics 42, 100936 (2019). no. ISSN 1474-0346
    Google Scholar
  6. Aparna, Y.B., Rai, R., Gupta, V., Aggarwal, N., Akula, A.: Convolutional neural networks based potholes detection using thermal imaging. J. King Saud Univ. Comp. Info. Sci. 34(3), 578–588 (2022)
    Google Scholar
  7. Kaźmierczak, S., Mańdziuk, J.: A Committee of convolutional neural networks for image classification in the concurrent presence of feature and label noise. In: Parallel Problem Solving from Nature – PPSN XVI: 16th International Conference, PPSN 2020,ACM DIgital Library, Leiden, The Netherlands,, September 5–9 (2020)
    Google Scholar
  8. Kang, B.-h., Choi, S.-i.: Pothole detection system using 2D LiDAR and camera. International Conference on Ubiquitous and Future Networks, no. ICUFN.2017.7993890, pp. 744–746 (2017)
    Google Scholar
  9. Deeksha Arya, H.M.S.K.G.D.T.Y.S.: RDD2020: An annotated image dataset for automatic road damage detection using deep learning. Data in Brief 36, 107133 (2021). no. ISSN 2352-3409
    Google Scholar
  10. Zhu, J., et al.: Pavement distress detection using convolutional neural networks with images captured via UAV. Automation in Construction 140, 103991 (2021). no. ISSN 0926-5805
    Google Scholar
  11. Mei, Q., Gül, M., Azim, M.R.: Densely connected deep neural network considering connectivity of pixels for automatic crack detection. Automation in Construction 110, 103018 (2020). no. ISSN 0926-5805
    Google Scholar
  12. Saad, A.M., Tahar, K.N.: Identification of rut and pothole by using multirotor unmanned aerial. J. Int. Measure. Confederat. 196, 0263–2241 (2019)
    Google Scholar
  13. Deeksha Arya, H.M.S.k.G.D.T.A.M.T.K.S.: Deep learning-based road damage detection and classification for multiple countries. Automation in Construction, 1–18 (2021)
    Google Scholar
  14. Maeda, H., et al.: Deep learning-based road damage detection and classification for multiple countries. Automation in Construction 140, 0926–5805 (2021)
    Google Scholar
  15. Aditi, K., Harsh, A., Abhishek, R., Chaudhari, B.N.: Pothole Detection using Accelerometer and Computer Vision with Automated Complaint Redressal. International Conference on Signal Processing and Communication, no. ICSPC51351.2021.9451762, pp. 257–264 (2021)
    Google Scholar
  16. Arya, D., Maeda, H., Ghosh, S.K., ToshniwalD., Sekimoto, Y.: RDD2020: An annotated image dataset for automatic road damage detection using deep learning. Data in Brief 36, 107133 (2021). no. ISSN 2352-3409
    Google Scholar
  17. Lakmal, H.K.I.S., Dissanayake, M.B.: Pothole detection with image segmentation for advanced driver assisted systems. In: IEEE International Women in Engineering (WIE) Conference on Electrical and Computer Engineering (WIECON-ECE), no. WIECON-ECE52138.2020.9398036, pp. 308–311 (2020)
    Google Scholar
  18. Kawasaki, Y., Matsushima, K., Zhong, Z.: Image-based pavement crack detection by percolation theory. In: 9th International Conference on Information Technology and Electrical Engineering, no. ICITEED.2017.8250508, pp. 1–6 (2017)
    Google Scholar

Download references

Author information

Authors and Affiliations

  1. Department of Computational Intelligence, SRMIST, Kattankulathur, India
    A. Jackulin Mahariba, A. L. Amutha & T. R. Saravanan
  2. Department of Computing Technologies, SRMIST, Kattankulathur, India
    S. Priya

Authors

  1. A. Jackulin Mahariba
  2. A. L. Amutha
  3. T. R. Saravanan
  4. S. Priya

Corresponding author

Correspondence toS. Priya .

Editor information

Editors and Affiliations

  1. SRM Institute of Science and Technology, Chennai, Tamil Nadu, India
    Annie Uthra R.
  2. Department of Computer Technology, Anna University, Chennai, Tamil Nadu, India
    Kottilingam Kottursamy
  3. Department of Computer Technology, Anna University, Chennai, Tamil Nadu, India
    Gunasekaran Raja
  4. Manchester Metropolitan University, Manchester, UK
    Ali Kashif Bashir
  5. Department of Computer Engineering, Süleyman Demirel University, Isparta, Türkiye
    Utku Kose
  6. SRM Institute of Science and Technology, Chennai, Tamil Nadu, India
    Revathi Appavoo
  7. SRM Institute of Science and Technology, Chennai, Tamil Nadu, India
    Vimaladevi Madhivanan

Rights and permissions

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Cite this paper

Mahariba, A.J., Amutha, A.L., Saravanan, T.R., Priya, S. (2024). Pothole Detection from an Enhanced Aerial Image Using CNN Model. In: R., A.U., et al. Deep Sciences for Computing and Communications. IconDeepCom 2023. Communications in Computer and Information Science, vol 2176. Springer, Cham. https://doi.org/10.1007/978-3-031-68905-5\_38

Download citation

Keywords

Publish with us