TY - CONF
T1 - Effect of speed difference between time-expanded speech and talker's moving image on word or sentence intelligibility
AU - Sakamoto, Shuichi
AU - Tanaka, Akihiro
AU - Tsumura, Komi
AU - Suzuki, Yôiti
N1 - Funding Information:
A part of this work was supported by a Grant-in-Aid for Specially Promoted Research No. 19001004 from MEXT Japan. The authors would like to thank Dr. Hideki Kawahara for permission to use the STRAIGHT vocoding method. The authors would also like to thank the members of the NHK Science and Technical Research Laboratories for their helpful comments on our research.
Publisher Copyright:
© 2007 Auditory-Visual Speech Processing 2007, AVSP 2007. All rights reserved.
PY - 2007
Y1 - 2007
N2 - This study investigated effects, on a speech intelligibility, of asynchronicity between a speech signal and a talker's moving image induced by time-expansion of the speech signal. First, a word intelligibility test (Exp. 1) was administered to younger listeners. Words were processed using STRAIGHT software to expand the speech signal by 0 to 400 ms. The word intelligibility test was administered under three conditions: visual-only, auditory-only, and auditory-visual (AV) conditions. Results showed that intelligibility scores under the AV condition were statistically higher than those under the auditory-only condition, even when the speech signal was expanded by 400 ms. Second, a sentence intelligibility test (Exp. 2) was administered to older adults. For all sentences, each phrase was expanded by 0 to 400 ms. This test was administered under the same conditions as those used for Exp. 1. Results showed that sentence intelligibility scores under the AV condition were statistically higher than those under the audio-only condition when the length of expansion was less than or equal to 200 ms. The results of Exp. 1 and Exp. 2 suggest that the talker's moving image is effective to enhance speech intelligibility if the lag between the speech signal and the talker's moving image is less than or equal to 200 ms.
AB - This study investigated effects, on a speech intelligibility, of asynchronicity between a speech signal and a talker's moving image induced by time-expansion of the speech signal. First, a word intelligibility test (Exp. 1) was administered to younger listeners. Words were processed using STRAIGHT software to expand the speech signal by 0 to 400 ms. The word intelligibility test was administered under three conditions: visual-only, auditory-only, and auditory-visual (AV) conditions. Results showed that intelligibility scores under the AV condition were statistically higher than those under the auditory-only condition, even when the speech signal was expanded by 400 ms. Second, a sentence intelligibility test (Exp. 2) was administered to older adults. For all sentences, each phrase was expanded by 0 to 400 ms. This test was administered under the same conditions as those used for Exp. 1. Results showed that sentence intelligibility scores under the AV condition were statistically higher than those under the audio-only condition when the length of expansion was less than or equal to 200 ms. The results of Exp. 1 and Exp. 2 suggest that the talker's moving image is effective to enhance speech intelligibility if the lag between the speech signal and the talker's moving image is less than or equal to 200 ms.
KW - audio-visual integration
KW - speech rate conversion
KW - word or sentence intelligibility
UR - http://www.scopus.com/inward/record.url?scp=77955222456&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=77955222456&partnerID=8YFLogxK
M3 - Paper
AN - SCOPUS:77955222456
T2 - 2007 International Conference on Auditory-Visual Speech Processing, AVSP 2007
Y2 - 31 August 2007 through 3 September 2007
ER -