Temporal characteristics of perceived reality of multimodal contents

Shuichi Sakamoto; Hiroyuki Yagyu; Zhenglie Cui; Tomoko Otani; Yôiti Suzuki; Jiro Gyoba

doi:10.1007/978-3-319-50209-0_25

Temporal characteristics of perceived reality of multimodal contents

Shuichi Sakamoto, Hiroyuki Yagyu, Zhenglie Cui, Tomoko Otani, Yôiti Suzuki, Jiro Gyoba

Human Information Systems Division

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Understanding the mechanism related to how people perceive reality is crucially important for the development of high-definition communication systems in multimedia contents. Various sensory information is well known to affect perceived reality from multimodal contents. For this purpose, it is important to present multimodal information with proper timing. This study investigated temporal characteristics of perceived reality induced by multimodal contents including vibration information. Results indicate that temporal characteristics of perceived reality depended on the timing of the events in the content, e.g. the timing with which the train just passes through an observation point. Moreover, the sense of presence was more sensitive to the timing of the presentation of sensory information with long contents.

Original language	English
Title of host publication	Advances in Intelligent Information Hiding and Multimedia Signal Processing - Proceeding of the 12th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, 2016
Editors	Hsiang-Cheh Huang, Jeng-Shyang Pan, Pei-Wei Tsai
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	199-206
Number of pages	8
ISBN (Print)	9783319502083
DOIs	https://doi.org/10.1007/978-3-319-50209-0_25
Publication status	Published - 2017 Jan 1
Event	12th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, IIH-MSP 2016 - Kaohsiung, Taiwan, Province of China Duration: 2016 Nov 21 → 2016 Nov 23

Publication series

Name	Smart Innovation, Systems and Technologies
Volume	63
ISSN (Print)	2190-3018
ISSN (Electronic)	2190-3026

Other

Other	12th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, IIH-MSP 2016
Country	Taiwan, Province of China
City	Kaohsiung
Period	16/11/21 → 16/11/23

Keywords

Multimodal integration
Reality perception
Sense of presence
Sense of verisimilitude
Stimulus onset asynchrony

ASJC Scopus subject areas

Decision Sciences(all)
Computer Science(all)

Access to Document

10.1007/978-3-319-50209-0_25

Fingerprint Dive into the research topics of 'Temporal characteristics of perceived reality of multimodal contents'. Together they form a unique fingerprint.

Cite this

Sakamoto, S., Yagyu, H., Cui, Z., Otani, T., Suzuki, Y., & Gyoba, J. (2017). Temporal characteristics of perceived reality of multimodal contents. In H-C. Huang, J-S. Pan, & P-W. Tsai (Eds.), Advances in Intelligent Information Hiding and Multimedia Signal Processing - Proceeding of the 12th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, 2016 (pp. 199-206). (Smart Innovation, Systems and Technologies; Vol. 63). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-319-50209-0_25

Temporal characteristics of perceived reality of multimodal contents. / Sakamoto, Shuichi; Yagyu, Hiroyuki; Cui, Zhenglie; Otani, Tomoko; Suzuki, Yôiti; Gyoba, Jiro.

Advances in Intelligent Information Hiding and Multimedia Signal Processing - Proceeding of the 12th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, 2016. ed. / Hsiang-Cheh Huang; Jeng-Shyang Pan; Pei-Wei Tsai. Springer Science and Business Media Deutschland GmbH, 2017. p. 199-206 (Smart Innovation, Systems and Technologies; Vol. 63).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Sakamoto, S, Yagyu, H, Cui, Z, Otani, T, Suzuki, Y & Gyoba, J 2017, Temporal characteristics of perceived reality of multimodal contents. in H-C Huang, J-S Pan & P-W Tsai (eds), Advances in Intelligent Information Hiding and Multimedia Signal Processing - Proceeding of the 12th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, 2016. Smart Innovation, Systems and Technologies, vol. 63, Springer Science and Business Media Deutschland GmbH, pp. 199-206, 12th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, IIH-MSP 2016, Kaohsiung, Taiwan, Province of China, 16/11/21. https://doi.org/10.1007/978-3-319-50209-0_25

Sakamoto S, Yagyu H, Cui Z, Otani T, Suzuki Y, Gyoba J. Temporal characteristics of perceived reality of multimodal contents. In Huang H-C, Pan J-S, Tsai P-W, editors, Advances in Intelligent Information Hiding and Multimedia Signal Processing - Proceeding of the 12th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, 2016. Springer Science and Business Media Deutschland GmbH. 2017. p. 199-206. (Smart Innovation, Systems and Technologies). https://doi.org/10.1007/978-3-319-50209-0_25

Sakamoto, Shuichi ; Yagyu, Hiroyuki ; Cui, Zhenglie ; Otani, Tomoko ; Suzuki, Yôiti ; Gyoba, Jiro. / Temporal characteristics of perceived reality of multimodal contents. Advances in Intelligent Information Hiding and Multimedia Signal Processing - Proceeding of the 12th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, 2016. editor / Hsiang-Cheh Huang ; Jeng-Shyang Pan ; Pei-Wei Tsai. Springer Science and Business Media Deutschland GmbH, 2017. pp. 199-206 (Smart Innovation, Systems and Technologies).

@inproceedings{dea1d6d2064243089bad510eb7dc7a6e,

title = "Temporal characteristics of perceived reality of multimodal contents",

abstract = "Understanding the mechanism related to how people perceive reality is crucially important for the development of high-definition communication systems in multimedia contents. Various sensory information is well known to affect perceived reality from multimodal contents. For this purpose, it is important to present multimodal information with proper timing. This study investigated temporal characteristics of perceived reality induced by multimodal contents including vibration information. Results indicate that temporal characteristics of perceived reality depended on the timing of the events in the content, e.g. the timing with which the train just passes through an observation point. Moreover, the sense of presence was more sensitive to the timing of the presentation of sensory information with long contents.",

keywords = "Multimodal integration, Reality perception, Sense of presence, Sense of verisimilitude, Stimulus onset asynchrony",

author = "Shuichi Sakamoto and Hiroyuki Yagyu and Zhenglie Cui and Tomoko Otani and Y{\^o}iti Suzuki and Jiro Gyoba",

year = "2017",

month = jan,

day = "1",

doi = "10.1007/978-3-319-50209-0_25",

language = "English",

isbn = "9783319502083",

series = "Smart Innovation, Systems and Technologies",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "199--206",

editor = "Hsiang-Cheh Huang and Jeng-Shyang Pan and Pei-Wei Tsai",

booktitle = "Advances in Intelligent Information Hiding and Multimedia Signal Processing - Proceeding of the 12th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, 2016",

address = "Germany",

note = "12th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, IIH-MSP 2016 ; Conference date: 21-11-2016 Through 23-11-2016",

}

TY - GEN

T1 - Temporal characteristics of perceived reality of multimodal contents

AU - Sakamoto, Shuichi

AU - Yagyu, Hiroyuki

AU - Cui, Zhenglie

AU - Otani, Tomoko

AU - Suzuki, Yôiti

AU - Gyoba, Jiro

PY - 2017/1/1

Y1 - 2017/1/1

N2 - Understanding the mechanism related to how people perceive reality is crucially important for the development of high-definition communication systems in multimedia contents. Various sensory information is well known to affect perceived reality from multimodal contents. For this purpose, it is important to present multimodal information with proper timing. This study investigated temporal characteristics of perceived reality induced by multimodal contents including vibration information. Results indicate that temporal characteristics of perceived reality depended on the timing of the events in the content, e.g. the timing with which the train just passes through an observation point. Moreover, the sense of presence was more sensitive to the timing of the presentation of sensory information with long contents.

AB - Understanding the mechanism related to how people perceive reality is crucially important for the development of high-definition communication systems in multimedia contents. Various sensory information is well known to affect perceived reality from multimodal contents. For this purpose, it is important to present multimodal information with proper timing. This study investigated temporal characteristics of perceived reality induced by multimodal contents including vibration information. Results indicate that temporal characteristics of perceived reality depended on the timing of the events in the content, e.g. the timing with which the train just passes through an observation point. Moreover, the sense of presence was more sensitive to the timing of the presentation of sensory information with long contents.

KW - Multimodal integration

KW - Reality perception

KW - Sense of presence

KW - Sense of verisimilitude

KW - Stimulus onset asynchrony

UR - http://www.scopus.com/inward/record.url?scp=85006074160&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85006074160&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-50209-0_25

DO - 10.1007/978-3-319-50209-0_25

M3 - Conference contribution

AN - SCOPUS:85006074160

SN - 9783319502083

T3 - Smart Innovation, Systems and Technologies

SP - 199

EP - 206

BT - Advances in Intelligent Information Hiding and Multimedia Signal Processing - Proceeding of the 12th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, 2016

A2 - Huang, Hsiang-Cheh

A2 - Pan, Jeng-Shyang

A2 - Tsai, Pei-Wei

PB - Springer Science and Business Media Deutschland GmbH

T2 - 12th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, IIH-MSP 2016

Y2 - 21 November 2016 through 23 November 2016

ER -