Visual speech improves the intelligibility of time-expanded auditory speech

Akihiro Tanaka, Shuichi Sakamoto, Komi Tsumura, Yôiti Suzuki

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

This study investigated the effects of intermodal timing differences and speed differences on word intelligibility of auditory-visual speech. Words were presented under visual-only, auditory-only, and auditory-visual conditions. Two types of auditory-visual conditions were used: asynchronous and expansion conditions. In the asynchronous conditions, the audio lag was 0-400 ms. In the expansion conditions, the auditory signal was time expanded (0-400 ms), whereas the visual signal was kept at the original speed. Results showed that word intelligibility was higher in the auditory-visual conditions than in the auditory-only condition. The results of auditory-visual benefit revealed that the benefit at the end of words declined as the amount of time expansion increased, although it did not decline in the asynchronous conditions.

Original languageEnglish
Pages (from-to)473-477
Number of pages5
JournalNeuroReport
Volume20
Issue number5
DOIs
Publication statusPublished - 2009 Mar 25

Keywords

  • Asynchrony
  • Audio-visual
  • Intelligibility
  • Multimodal
  • Speech perception
  • Speech-rate conversion

ASJC Scopus subject areas

  • Neuroscience(all)

Fingerprint Dive into the research topics of 'Visual speech improves the intelligibility of time-expanded auditory speech'. Together they form a unique fingerprint.

  • Cite this