Data collection and analysis for automatically generating record of human behaviors by environmental sound recognition

Takahiro Furuya, Yuya Chiba, Takashi Nose, Akinori Ito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Nowadays, the “life-log,” recording our daily activities using a camera, microphone or other sensors and retrieve those recorded data, is becoming more and more realistic. One of the applications that utilize the life-log data is the automatic generation of activity summary of the user. The present work focuses on using sound data to make the activity summary. There have been several works that classified the recorded sound based on the user’s activity. The focus of those studies was how to classify the collected data into a pre-defined set of activity classes. However, there have been no considerations what kind of activity classes were appropriate for this purpose. Moreover, we need a basic investigation for optimizing parameters of sound recognition such as window size for feature calculation. Therefore, we first investigated the optimum parameters for feature extraction, and then analyzed the acoustic similarities of sound features observed by various activities. We exploited twenty-two hours of environmental sound in a test subject’s ordinal life as the training and test data. Using the data, we analyzed the acoustic similarities of the activity sound using hierarchical clustering. As a consequence, we observed that target classes could be classified into three groups (“speaking,” “silent” and “noisy”). Misrecognitions between those groups were rare, and we observed a large number of misrecognitions within the “speaking” group.

Original languageEnglish
Title of host publicationRecent Advances in Intelligent Information Hiding and Multimedia Signal Processing - Proceeding of the Fourteenth International Conference on Intelligent Information Hiding and Multimedia Signal Processing
EditorsLakhmi C. Jain, Lakhmi C. Jain, Pei-Wei Tsai, Akinori Ito, Jeng-Shyang Pan, Lakhmi C. Jain
PublisherSpringer Science and Business Media Deutschland GmbH
Pages149-156
Number of pages8
ISBN (Print)9783030037475
DOIs
Publication statusPublished - 2019 Jan 1
Event14th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, IIH-MSP 2018 - Sendai, Japan
Duration: 2018 Nov 262018 Nov 28

Publication series

NameSmart Innovation, Systems and Technologies
Volume110
ISSN (Print)2190-3018
ISSN (Electronic)2190-3026

Other

Other14th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, IIH-MSP 2018
CountryJapan
CitySendai
Period18/11/2618/11/28

Keywords

  • Environmental sound recognition
  • Hierarchical clustering
  • Neural network

ASJC Scopus subject areas

  • Decision Sciences(all)
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Data collection and analysis for automatically generating record of human behaviors by environmental sound recognition'. Together they form a unique fingerprint.

Cite this