Effect of full-body vibration generated from audio signal on perceived reality

Zhenglie Cui, Hiroyuki Yagyu, Shuichi Sakamoto, Yoiti Suzuki, Jiro Gyoba

Research output: Contribution to conferencePaperpeer-review

Abstract

To better understand the environment that surrounds an observer, it is highly effective to use not only audio-visual information, but also information of other sensory modalities such as touch, smell, and vibration. In virtual environments, it is highly desired to develop advanced multi-modal displays that present various kinds of sensory information in ways and amounts consistent with human perception processes. With this motivation, we examined the effect of full-body vibration to enhance perceived reality of audio-visual content. Almost all multimedia content that is easily available only includes audio-visual information. We thus investigated various ways of generating vibration information to effectively enhance reality from other sensory information, especially from sound. In this study, we generated such vibration information from low frequency components (< 70 Hz) of the audio signal of audio-visual content. The results of the subjective evaluation experiment revealed that generated vibration can enhance perceived reality (the senses of presence and verisimilitude) of multi-modal content both during the presentation of the content as well as after viewing. Specifically, in almost all experimental conditions with vibration, irrespective of whether the vibration was originally recorded or generated, the senses of presence and verisimilitude are heightened over those conditions without vibration. From the results of the evaluation of after viewing, the perception of verisimilitude becomes high when the vibration levels are similar to the recorded original ones. Moreover, it was observed that the sense of verisimilitude more sensitively depends on the vibration level than does the sense of presence. These results show that artificially generated vibration from auditory information effectively enhances perceived reality. The results also suggest the importance of verisimilitude as another useful measure to evaluate the perceived reality in addition to the sense of presence.

Original languageEnglish
Publication statusPublished - 2017 Jan 1
Event46th International Congress and Exposition on Noise Control Engineering: Taming Noise and Moving Quiet, INTER-NOISE 2017 - Hong Kong, China
Duration: 2017 Aug 272017 Aug 30

Other

Other46th International Congress and Exposition on Noise Control Engineering: Taming Noise and Moving Quiet, INTER-NOISE 2017
CountryChina
CityHong Kong
Period17/8/2717/8/30

Keywords

  • Affective perception
  • Full-body vibration
  • Multimodal perception
  • Reality
  • Sense of presence
  • Sense of verisimilitude I-INCE classification of subjects number(s): 51.4

ASJC Scopus subject areas

  • Acoustics and Ultrasonics

Fingerprint Dive into the research topics of 'Effect of full-body vibration generated from audio signal on perceived reality'. Together they form a unique fingerprint.

Cite this