Autonomous Pedestrian Detection model for Crowd Surveillance using Deep Learning Framework (original) (raw)

Faster R-CNN Deep Learning Model for Pedestrian Detection from Drone Images

SN Computer Science

Pedestrian detection from a drone-based images has many potential applications such as searching for missing persons, surveillance of illegal immigrants, and monitoring of critical infrastructure. However, it is considered as a very challenge computer vision problem due to the variations in camera point of view, distance from pedestrian, changes in illuminations and weather conditions, variation in the surrounding objects, as well as present of human-like objects. Recently, deep learningbased models are getting more attention, and they have proven a great success in many object detection problems such as the detection of faces, breast masses, and vehicles. As such, this work aims to develop a deep learning-based model that will be applied for the problem of pedestrian detection from a drone-based images. Particularly, faster region-based convolutional neural network (Faster R-CNN) will be used to search for the present of a pedestrian inside the captured drone-based images. To assess the performances, a total of 1500 images were collected by S30W drone and these images were captured at different places, with various views and weather conditions, and at daytime and night-time. Results show that Faster R-CNN was able to achieve a promising result with 98% precision, 99% recall, and 98% F1 measure. Further analysis has been conducted by comparing the outcomes of Faster R-CNN with YOLO deep model on UAV123 publicly available dataset. The reported results indicated that both detection models almost reported very similar results.

Object Detection in Deep Surveillance

2021

Object detection is a key ability required by most computer visions and surveillance applications. Pedestrian detection is a key problem in surveillance, with several applications such as person identification, person count and tracking. The number of techniques to identifying pedestrians in images has gradually increased in recent years, even with the significant advances in the state-of-the-art deep neural network-based framework for object detection models. The research in the field of object detection and image classification has made a stride in the level of accuracy greater than 99% and the level of granularity. A powerful Object detector, specifically designed for high-end surveillance applications, is needed that will not only position the bounding box and label it but will also return their relative positions. The size of these bounding boxes can vary depending on the object and it interacts with the physical world. To address these requirements, an extensive evaluation of ...

Pedestrian detection system based on deep learning

International Journal of Advances in Applied Sciences (IJAAS), 2022

Pedestrian detection is a rapidly growing field of computer vision with applications in smart cars, surveillance, automotive safety, and advanced robotics. Most of the success of the last few years has been driven by the rapid growth of deep learning, more efficient tools capable of learning semantic, high-level, deeper features of images are proposed. In this article, we investigated the task of pedestrian detection on roads using models based on convolutional neural networks. We compared the performance of standard state-of-the-art object detectors like Faster region-based convolutional network (R-CNN), single shot detector (SSD), and you only look once, version 3 (YOLOv3). Results show that YOLOv3 is the best object detection model than others for pedestrians in terms of detection and time prediction. This is an open access article under the CC BY-SA license.

Comparative Study of Some Deep Learning Object Detection Algorithms: R-CNN, FAST R-CNN, FASTER R-CNN, SSD, and YOLO

Due to its numerous applications and new technological advancements, object detection has gained more attention in the last few years. This study examined various uses of some deep learning object detection algorithms. These algorithms are divided into two-stage detectors like Region Based Convolutional Neural Network (R-CNN), Fast Region Based Convolutional Neural Network (Faster R-CNN), and Faster Region Based Convolutional Neural Network (Faster R-CNN), and one-stage detectors like Single Shot MultiBox Detector (SSD) and You Only Look Once (YOLO) algorithms that are used in text and face detection, image retrieval, security, surveillance, traffic control, traffic sign/light detection, pedestrian detection and in medical areas among others. This research primarily focuses on three applications: drone surveillance, applications relating to traffic, and medical fields. Findings from the performed analysis indicate that YOLO stands out as the predominant algorithm for drone surveillance among different deep learning models used in various application fields and being a one-stage detector. In terms of usage in traffic-related applications, SSD proved to be a prominent one-stage detector alongside Faster R-CNN which gained popularity as a two-stage detector preferred for applications in the medical field.

Pedestrian Detection Based on Deep Learning

International Journal for Research in Applied Science & Engineering Technology (IJRASET), 2022

Pedestrian detection is most commonly employed in autonomous driving circumstances that necessitate rapid detection. It is also very useful for the purpose of video surveillance and other similar purpose. The primary goal of this project is to create a system that recognises pedestrians from video, or a stream of video sent to the system in the form of previously recorded video or real-time camera input. Bounding boxes will be drawn around the things that the system has spotted along with the confidence score of prediction. This project employs Python programming and the YOLO machine learning technology.

Pedestrian and Vehicle Detection System Based on Deep Learning

IJSES, 2024

This paper discusses the application of deep learning technology in the field of pedestrian and vehicle detection. Pedestrian and vehicle detection is an important problem in computer vision, which has a wide range of practical applications. We review YOLO algorithms and their applications in pedestrian and vehicle detection. The selection and labeling methods of data sets, model training and optimization strategies, and the application of evaluation indexes are discussed. Finally, we analyze current technology challenges and future directions, including improved detection accuracy, real-time performance, and further improvements in the generalization ability of complex scenarios.

Computer vision and deep learning techniques for pedestrian detection and tracking: A survey

Neurocomputing, 2018

Pedestrian detection and tracking have become an important field in the computer vision research area. This growing interest, started in the last decades, might be explained by the multitude of potential applications that could use the results of this research field, e.g. robotics, entertainment, surveillance, care for the elderly and disabled, and content-based indexing. In this survey paper, vision-based pedestrian detection systems are analysed based on their field of application, acquisition technology, computer vision techniques and classification strategies. Three main application fields have been individuated and discussed: video surveillance, human-machine interaction and analysis. Due to the large variety of acquisition technologies, this paper discusses both the differences between 2D and 3D vision systems, and indoor and outdoor systems. The authors reserved a dedicated section for the analysis of the Deep Learning methodologies, including the Convolutional Neural Networks in pedestrian detection and tracking, considering their recent exploding adoption for such a kind systems. Finally, focusing on the classification point of view, different Machine Learning techniques have been analysed, basing the discussion on the classification performances on different benchmark datasets. The reported results highlight the importance of testing pedestrian detection systems on different datasets to evaluate the robustness of the computed groups of features used as input to classifiers.

Deep Convolutional Neural Networks for pedestrian detection

Signal Processing: Image Communication, 2016

Pedestrian detection is a popular research topic due to its paramount importance for a number of applications, especially in the fields of automotive, surveillance and robotics. Despite the significant improvements, pedestrian detection is still an open challenge that calls for more and more accurate algorithms. In the last few years, deep learning and in particular convolutional neural networks emerged as the state of the art in terms of accuracy for a number of computer vision tasks such as image classification, object detection and segmentation, often outperforming the previous gold standards by a large margin. In this paper, we propose a pedestrian detection system based on deep learning, adapting a general-purpose convolutional network to the task at hand. By thoroughly analyzing and optimizing each step of the detection pipeline we propose an architecture that outperforms traditional methods, achieving a task accuracy close to that of state-of-the-art approaches, while requiring a low computational time. Finally, we tested the system on an NVIDIA Jetson TK1, a 192-core platform that is envisioned to be a forerunner computational brain of future self-driving cars.

Fine-Tuning Deep Learning Models for Pedestrian Detection

Boletim De Ciencias Geodesicas, 2021

Abstract: Object detection in high resolution images is a new challenge that the remote sensing community is facing thanks to introduction of unmanned aerial vehicles and monitoring cameras. One of the interests is to detect and trace persons in the images. Different from general objects, pedestrians can have different poses and are undergoing constant morphological changes while moving, this task needs an intelligent solution. Fine-tuning has woken up great interest among researchers due to its relevance for retraining convolutional networks for many and interesting applications. For object classification, detection, and segmentation fine-tuned models have shown state-of-the-art performance. In the present work, we evaluate the performance of fine-tuned models with a variation of training data by comparing Faster Region-based Convolutional Neural Network (Faster R-CNN) Inception v2, Single Shot MultiBox Detector (SSD) Inception v2, and SSD Mobilenet v2. To achieve the goal, the eff...

Pedestrian Detection System Using Deep Convolutional Neural Networks

2017

Pedestrian recognition is a key problem for a number of application domains namely autonomous driving, search and rescue, surveillance and robotics. Real-time pedestrian recognition entails determining if a pedestrian is in an image frame. State-of-art pedestrian detection convolution neural networks(CNN) such as Fast R-CNN depend on computationally expensive region detection algorithms to hypothesize pedestrian locations. This paper presents a simple, fast and very accurate approach by cascading fast regional detection and deep convolution networks. Convolution networks have been shown to excel at image classification. However, convolution networks are notoriously slow at inference time. In this work, we introduce a fast regional detection cascaded with deep convolution networks that enables real-time pedestrian detection that could be used to alert a driver if a pedestrian is on the roadway. The classification CNN has given an accuracy of 95.7%, with a processing rate of about 15 ...