Pedestrian tracking with occlusion state estimation

Akihiro Enomura, Toru Abe, Takuo Suganuma

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Visual tracking of multiple pedestrians in video sequences is an important procedure for many computer vision applications. The tracking-by-detection approach is widely used for visual pedestrian tracking. This approach extracts pedestrian regions from each video frame and associates the extracted regions across frames as the same pedestrian according to the similarities of region features (e.g., position, appearance, and movement). When a pedestrian is temporarily occluded by a still obstacle in the scene, he/she disappears at one side of the obstacle in a certain frame and then reappears at the other side of it a few frames later. The occlusion state of the pedestrian, that is the space-time interval where the pedestrian is missing, varies with obstacle areas and pedestrian movements. Such an unknown occlusion state complicates the region association process for the same pedestrian and makes the pedestrian tracking difficult. To solve this difficulty and improve pedestrian tracking robustness, we propose a novel method for tracking pedestrians while estimating their occlusion states. Our method acquires obstacle areas by the pedestrian regions extracted from each frame, estimates the occlusion states from the acquired obstacle areas and pedestrian movements, and reflects the estimated occlusion states in the region association process.

Original languageEnglish
Title of host publicationVISAPP
EditorsGiovanni Maria Farinella, Petia Radeva, Jose Braz
PublisherSciTePress
Pages704-713
Number of pages10
ISBN (Electronic)9789897584022
Publication statusPublished - 2020
Event15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2020 - Valletta, Malta
Duration: 2020 Feb 272020 Feb 29

Publication series

NameVISIGRAPP 2020 - Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications
Volume4

Conference

Conference15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2020
CountryMalta
CityValletta
Period20/2/2720/2/29

Keywords

  • Obstacle Area
  • Occlusion State
  • Pedestrian Movement
  • Pedestrian Tracking
  • Tracking-by-Detection

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Science Applications
  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Pedestrian tracking with occlusion state estimation'. Together they form a unique fingerprint.

Cite this