A method for detecting human-object interaction based on motion distribution around hand

Tatsuhiro Tsukamoto, Toru Abe, Takuo Suganuma

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Detecting human-object interaction in video images is an important issue in many computer vision applications. Among various types of human-object interaction, especially the type of interaction where a person is in the middle of moving an object with his/her hand is a key to observing several critical events such as stealing luggage and abandoning suspicious substances in public spaces. This paper proposes a novel method for detecting such type of human-object interaction. In the proposed method, an area surrounding each hand is set in input video frames, and the motion distribution in every surrounding area is analyzed. Whether or not each hand moves an object is decided by whether or not its surrounding area contains regions where movements similar to those of the hand are concentrated. Since the proposed method needs not explicitly extract object regions and recognize their relations to person regions, the effectiveness in detecting the human-object interaction, technically hands which are right in the middle of moving objects, is expected to be improved for diverse situations, e.g., several persons individually move unknown objects with their hands in a scene.

Original languageEnglish
Title of host publicationVISAPP
EditorsGiovanni Maria Farinella, Petia Radeva, Jose Braz
PublisherSciTePress
Pages462-469
Number of pages8
ISBN (Electronic)9789897584022
Publication statusPublished - 2020 Jan 1
Event15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2020 - Valletta, Malta
Duration: 2020 Feb 272020 Feb 29

Publication series

NameVISIGRAPP 2020 - Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications
Volume5

Conference

Conference15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2020
CountryMalta
CityValletta
Period20/2/2720/2/29

Keywords

  • Forearm Movement
  • Human Skeleton
  • Human-object Interaction Detection
  • Motion around Hand

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Science Applications
  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'A method for detecting human-object interaction based on motion distribution around hand'. Together they form a unique fingerprint.

Cite this