Toward a subjective synchronous communication in multimodal human-machine interaction: Intention of movement alternates simultaneous perception in auditory-tactile temporal order judgment

Atsuhiro Nishi, Masanori Yokoyama, Taiki Ogata, Takayuki Nozawa, Yoshihiro Miyake

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We investigated the effect of voluntary movement on temporal multimodal integration using a psychological experiment. The present study used auditory-tactile Temporal Order Judgment (TOJ) task to measure the differences in Point of Subjective Simultaneity (PSS) and Just Noticeable Difference (JND). To distinguish the effect of voluntary movement and proprioceptive feedback, we prepared three conditions: Voluntary condition, Involuntary condition, and No-movement condition. Voluntary movement and Involuntary movement shifted PSS to the point where an auditory stimulus presented prior to a tactile stimulus compared to No-movement condition. Furthermore, the shift of PSS in Voluntary condition was larger than that in Involuntary condition. JND of Voluntary condition was smaller than those of the other two conditions. These results revealed that voluntary movement improved temporal resolution between auditory and tactile stimuli. Moreover, it was demonstrated that voluntary movement also alternates audio-tactile temporal integration.

Original languageEnglish
Title of host publication2012 International Symposium on Micro-NanoMechatronics and Human Science, MHS 2012
Pages466-469
Number of pages4
DOIs
Publication statusPublished - 2012 Dec 1
Event23rd Annual Symposium on Micro-Nano Mechatronics and Human Science, MHS 2012 - Nagoya, Japan
Duration: 2012 Nov 42012 Nov 7

Publication series

Name2012 International Symposium on Micro-NanoMechatronics and Human Science, MHS 2012

Other

Other23rd Annual Symposium on Micro-Nano Mechatronics and Human Science, MHS 2012
CountryJapan
CityNagoya
Period12/11/412/11/7

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Mechanical Engineering

Fingerprint Dive into the research topics of 'Toward a subjective synchronous communication in multimodal human-machine interaction: Intention of movement alternates simultaneous perception in auditory-tactile temporal order judgment'. Together they form a unique fingerprint.

Cite this