To better understand the environment that surrounds an observer, it is highly effective to use not only audio-visual information, but also information of other sensory modalities such as touch, smell, and vibration. In virtual environments, it is highly desired to develop advanced multi-modal displays that present various kinds of sensory information in ways and amounts consistent with human perception processes. With this motivation, we examined the effect of full-body vibration to enhance perceived reality of audio-visual content. Almost all multimedia content that is easily available only includes audio-visual information. We thus investigated various ways of generating vibration information to effectively enhance reality from other sensory information, especially from sound. In this study, we generated such vibration information from low frequency components (< 70 Hz) of the audio signal of audio-visual content. The results of the subjective evaluation experiment revealed that generated vibration can enhance perceived reality (the senses of presence and verisimilitude) of multi-modal content both during the presentation of the content as well as after viewing. Specifically, in almost all experimental conditions with vibration, irrespective of whether the vibration was originally recorded or generated, the senses of presence and verisimilitude are heightened over those conditions without vibration. From the results of the evaluation of after viewing, the perception of verisimilitude becomes high when the vibration levels are similar to the recorded original ones. Moreover, it was observed that the sense of verisimilitude more sensitively depends on the vibration level than does the sense of presence. These results show that artificially generated vibration from auditory information effectively enhances perceived reality. The results also suggest the importance of verisimilitude as another useful measure to evaluate the perceived reality in addition to the sense of presence.
|出版ステータス||Published - 2017 1 1|
|イベント||46th International Congress and Exposition on Noise Control Engineering: Taming Noise and Moving Quiet, INTER-NOISE 2017 - Hong Kong, China|
継続期間: 2017 8 27 → 2017 8 30
|Other||46th International Congress and Exposition on Noise Control Engineering: Taming Noise and Moving Quiet, INTER-NOISE 2017|
|Period||17/8/27 → 17/8/30|
ASJC Scopus subject areas