Online multiple people tracking-by-detection in crowded scenes (original) (raw)

Part-based multiple-person tracking with partial occlusion handling

2012 IEEE Conference on Computer Vision and Pattern Recognition, 2012

Single camera-based multiple-person tracking is often hindered by difficulties such as occlusion and changes in appearance. In this paper, we address such problems by proposing a robust part-based tracking-by-detection framework. Human detection using part models has become quite popular, yet its extension in tracking has not been fully explored. Our approach learns part-based person-specific SVM classifiers which capture the articulations of the human bodies in dynamically changing appearance and background. With the part-based model, our approach is able to handle partial occlusions in both the detection and the tracking stages. In the detection stage, we select the subset of parts which maximizes the probability of detection, which significantly improves the detection performance in crowded scenes. In the tracking stage, we dynamically handle occlusions by distributing the score of the learned person classifier among its corresponding parts, which allows us to detect and predict partial occlusions, and prevent the performance of the classifiers from being degraded. Extensive experiments using the proposed method on several challenging sequences demonstrate state-of-the-art performance in multiple-people tracking.

Multiple Human Objects Tracking in Crowded Scenes

18th International Conference on Pattern Recognition (ICPR'06), 2006

This paper introduces a multiple human objects tracking system to detect and track multiple objects in the crowded scene in which occlusions occur. Our method assign each pixel to different human object based on its relative distance to that object and the corresponding color model. If no occlusion, we easily track each object independently based on each segmented object region and optical flow. With occlusion, we analyze the color distribution of the occlusion group to differentiate each object in the group. By calculating the distances between objects, we can determine whether an object is separated from the occlusion group and to be tracked individually afterwards.

Online Multiperson Tracking-by-Detection from a Single, Uncalibrated Camera

IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000

In this paper, we address the problem of automatically detecting and tracking a variable number of persons in complex scenes using a monocular, potentially moving, uncalibrated camera. We propose a novel approach for multi-person tracking-bydetection in a particle filtering framework. In addition to final high-confidence detections, our algorithm uses the continuous confidence of pedestrian detectors and online trained, instance-specific classifiers as a graded observation model. Thus, generic object category knowledge is complemented by instance-specific information. The main contribution of this paper is to explore how these unreliable information sources can be used for robust multi-person tracking. The algorithm detects and tracks a large number of dynamically moving persons in complex scenes with occlusions, does not rely on background modeling, requires no camera or ground plane calibration, and only makes use of information from the past. Hence, it imposes very few restrictions and is suitable for online applications. Our experiments show that the method yields good tracking performance in a large variety of highly dynamic scenarios, such as typical surveillance videos, webcam footage, or sports sequences. We demonstrate that our algorithm outperforms other methods that rely on additional information. Furthermore, we analyze the influence of different algorithm components on the robustness.

Multiple People Detection and Tracking

Mantech Publications , 2021

Multiple people detection in real-time is still a challenging task despite having different techniques. It is challenging because partially occluded people are still often not recognized in a heavily populated area, and also due to Non-Maximum suppression, correct bounding boxes are also discarded, which leads to imprecision in the detections. This paper presents the various modifications done to multiple people detection and tracking algorithms, which improves the efficiency and accuracy of the previously used cases.

Improved Tracking of Multiple Humans with Trajectory Prediction and Occlusion Modeling

1998

A combined 2D, 3D approach is presented that allows for robust tracking of moving bodies in a given environment as observed via a single, uncalibrated video camera. Lowlevel features are often insufficient for detection, segmentation, and tracking of non-rigid moving objects. Therefore, an improved mechanism is proposed that combines lowlevel (image processing) and mid-level (recursive trajectory estimation) information obtained during the tracking process. The resulting system can segment and maintain the tracking of moving objects before, during, and after occlusion. At each frame, the system also extracts a stabilized coordinate frame of the moving objects. This stabilized frame can be used as input to motion recognition modules. The approach enables robust tracking without constraining the system to know the shape of the objects being tracked beforehand; although, some assumptions are made about the characteristics of the shape of the objects, and how they evolve with time. Experiments in tracking moving people are described.

Occlusion-Robust Pedestrian Tracking in Crowded Scenes

2015 IEEE 18th International Conference on Intelligent Transportation Systems, 2015

This paper focuses on tracking in typical traffic monitoring scenarios with emphasis on handling occlusions caused by trees, lampposts and cables. We extend the existing TRacking with Occlusion handling and Drift correction (TROD) algorithm with a novel occlusion detection algorithm, based on measuring the changes in the object motion pattern. The motion information is extracted via frame differencing and described a the HOG descriptor. Occlusions are handled by preventing the model update and predicting the object location based on prior observations. Our proposed system clearly outperforms state-of-the-art tracking algorithms for larger occlusions in the specific pedestrian surveillance scenario, that is, the percentage of successfully tracked objects grows with 10-15%. At the same time, for non-specific public datasets, the performance is similar to existing state-of-the-art tracking algorithms.

Multiple-Object Tracking in Cluttered and Crowded Public Spaces

International Symposium on Visual Computing, 2010

This paper addresses the problem of tracking moving objects of variable appearance in challenging scenes rich with features and texture. Reliable tracking is of pivotal importance in surveillance applications. It is made particularly difficult by the nature of objects encountered in such scenes: these too change in appearance and scale, and are often articulated (e.g. humans). We propose a method which uses fast motion detection and segmentation as a constraint for both building appearance models and their robust propagation (matching) in time. The appearance model is based on sets of local appearances automatically clustered using spatio-kinetic similarity, and is updated with each new appearance seen. This integration of all seen appearances of a tracked object makes it extremely resilient to errors caused by occlusion and the lack of permanence of due to low data quality, appearance change or background clutter. These theoretical strengths of our algorithm are empirically demonstrated on two hour long video footage of a busy city marketplace.

Person tracking with partial occlusion handling

2015 IEEE Workshop on Signal Processing Systems (SiPS), 2015

Occlusion is a challenge for tracking especially in dynamic scene. It adds the consideration for background modeling. In the condition, the tracker will be influenced by both occlusions and background. In this paper, we address the problem by proposing a robust algorithm based on improved particle filter using discriminative model without background modeling. Discriminative model offers accurate templates for occlusion detection by alleviating influence from background pixels. Since particle filter cannot carry out effective tracking under heavy occlusion, blocking is introduced to solve the problem by abandoning unobservable parts of the target. Experimental results show that our algorithm can work persistently and effectively under severe occlusion even in dynamic scene compared with state-of-the-arts.

Segmentation and tracking of multiple humans in crowded environments

2008

Segmentation and tracking of multiple humans in crowded situations is made difficult by interobject occlusion. We propose a model-based approach to interpret the image observations by multiple partially occluded human hypotheses in a Bayesian framework. We define a joint image likelihood for multiple humans based on the appearance of the humans, the visibility of the body obtained by occlusion reasoning, and foreground/background separation. The optimal solution is obtained by using an efficient sampling method, data-driven Markov chain Monte Carlo (DDMCMC), which uses image observations for proposal probabilities. Knowledge of various aspects, including human shape, camera model, and image cues, are integrated in one theoretically sound framework. We present experimental results and quantitative evaluation, demonstrating that the resulting approach is effective for very challenging data.