Sensory Equivalence Conversion of High-Frequency Vibrotactile Signals using Intensity Segment Modulation Method for Enhancing Audiovisual Experience

Kosuke Yamaguchi, Masashi Konyo, Satoshi Tadokoro

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

High-frequency vibrations over a wide range can enhance the audiovisual experience. However, they require a high-response actuator and often cause acoustic noise. This study proposes a general conversion method of high-frequency vibrations into lower frequency ones while maintaining the original vibrotactile sensation. We developed the intensity segment modulation (ISM) method, which relies on the intensity-based perception model and the human capacity to detect temporal fluctuations in intensity at less than 100 Hz frequencies. The ISM allows us to convert any high-frequency vibrations (including the human auditory range) into a lower-frequency vibration at 150 - 300 Hz, which is suitable for typical haptic vibrators. The method divides the original signals into time segments in a specific period to match the human temporal resolution. Then, it calculates the intensity of each segment by decomposing the signals. ISM can output an amplitude-modulated waveform with a single carrier frequency. The sensory equivalence experiment showed that harmonic and percussive types vibrations at 400 Hz and 600 Hz were successfully converted into vibrations of 150 - 300 Hz with almost similar sensations or slightly different. The subjective evaluation of two video contents, i.e., a violin player and fireworks, demonstrated that the proposed method could deliver better-augmented reality.

Original languageEnglish
Title of host publication2021 IEEE World Haptics Conference, WHC 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages674-679
Number of pages6
ISBN (Electronic)9781665418713
DOIs
Publication statusPublished - 2021 Jul 6
Event2021 IEEE World Haptics Conference, WHC 2021 - Virtual, Montreal, Canada
Duration: 2021 Jul 62021 Jul 9

Publication series

Name2021 IEEE World Haptics Conference, WHC 2021

Conference

Conference2021 IEEE World Haptics Conference, WHC 2021
Country/TerritoryCanada
CityVirtual, Montreal
Period21/7/621/7/9

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Control and Optimization
  • Sensory Systems

Fingerprint

Dive into the research topics of 'Sensory Equivalence Conversion of High-Frequency Vibrotactile Signals using Intensity Segment Modulation Method for Enhancing Audiovisual Experience'. Together they form a unique fingerprint.

Cite this