Impact of audio-visual asynchrony on lip- reading effects -neuromagnetic and psychophysical study-

Tetsuaki Kawase, Izumi Yahata, Akitake Kanno, Shuichi Sakamoto, Yoshitaka Takanashi, Shiho Takata, Nobukazu Nakasato, Ryuta Kawashima, Yukio Katori

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

The effects of asynchrony between audio and visual (A/V) stimuli on the N100m responses of magnetoencephalography in the left hemisphere were compared with those on the psychophysical responses in 11 participants. The latency and amplitude of N100m were significantly shortened and reduced in the left hemisphere by the presentation of visual speech as long as the temporal asynchrony between A/V stimuli was within 100 ms, but were not significantly affected with audio lags of -500 and +500 ms. However, some small effects were still preserved on average with audio lags of 500 ms, suggesting similar asymmetry of the temporal window to that observed in psychophysical measurements, which tended to be more robust (wider) for audio lags; i.e., the pattern of visual-speech effects as a function of A/V lag observed in the N100m in the left hemisphere grossly resembled that in psychophysical measurements on average, although the individual responses were somewhat varied. The present results suggest that the basic configuration of the temporal window of visual effects on auditory-speech perception could be observed from the early auditory processing stage.

Original languageEnglish
Article numbere0168740
JournalPloS one
Volume11
Issue number12
DOIs
Publication statusPublished - 2016 Dec

ASJC Scopus subject areas

  • Biochemistry, Genetics and Molecular Biology(all)
  • Agricultural and Biological Sciences(all)
  • General

Fingerprint Dive into the research topics of 'Impact of audio-visual asynchrony on lip- reading effects -neuromagnetic and psychophysical study-'. Together they form a unique fingerprint.

Cite this