TY - JOUR
T1 - Audiovisual synchrony perception of simplified speech sounds heard as speech and non-speech
AU - Asakawa, Kaori
AU - Tanaka, Akihiro
AU - Sakamoto, Shuichi
AU - Iwaya, Yukio
AU - Suzuki, Yôiti
PY - 2011
Y1 - 2011
N2 - Listeners without information about SWS typically perceive this sound as non-speech such as a whistle or electronic sound. In contrast, once they are informed that SWS is a synthesized speech sound based on natural speech, they perceive SWS as speech. Audiovisual synchrony is important for comfortable speech communication. Ocasionally a temporal mismatch is encountered between a speaker's face and speech sound, for instance, in a satellite broadcast or in video streaming via the Internet. They showed that participants were less sensitive to audiovisual asynchrony when the auditory and visual stimuli originated from the same speech event than when they originated from different speech events. The findings reveal the role of a purely cognitive effect in audiovisual synchrony perception, and suggest that synchrony perception might be affected by the sound discriminability. Further studies are required to reveal the relevance of the relation between audiovisual synchrony perception and stimulus discriminability.
AB - Listeners without information about SWS typically perceive this sound as non-speech such as a whistle or electronic sound. In contrast, once they are informed that SWS is a synthesized speech sound based on natural speech, they perceive SWS as speech. Audiovisual synchrony is important for comfortable speech communication. Ocasionally a temporal mismatch is encountered between a speaker's face and speech sound, for instance, in a satellite broadcast or in video streaming via the Internet. They showed that participants were less sensitive to audiovisual asynchrony when the auditory and visual stimuli originated from the same speech event than when they originated from different speech events. The findings reveal the role of a purely cognitive effect in audiovisual synchrony perception, and suggest that synchrony perception might be affected by the sound discriminability. Further studies are required to reveal the relevance of the relation between audiovisual synchrony perception and stimulus discriminability.
KW - Audiovisual speech integration
KW - Sine-wave speech
KW - Synchrony perception
UR - http://www.scopus.com/inward/record.url?scp=79955621485&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=79955621485&partnerID=8YFLogxK
U2 - 10.1250/ast.32.125
DO - 10.1250/ast.32.125
M3 - Article
AN - SCOPUS:79955621485
VL - 32
SP - 125
EP - 128
JO - Journal of the Acoustical Society of Japan (E) (English translation of Nippon Onkyo Gakkaishi)
JF - Journal of the Acoustical Society of Japan (E) (English translation of Nippon Onkyo Gakkaishi)
SN - 1346-3969
IS - 3
ER -