Intonation evaluation of English utterances using synthesized speech for computer-assisted language learning

Tomoaki Konno, Akinori Ito, Masashi Ito, Shozo Makino, Motoyuki Suzuki

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

In this paper, we describe a system for intonation evaluation of English utterance by Japanese native speakers using synthesized speech for rapid development of a CALL system. To evaluate the intonation of learners' utterance, we need reference utterances, for which English native speakers' utterances should be used. However, it is costly to gather native speakers' utterances for all sentences in the system. Therefore, we examined an intonation evaluation method using synthesized speech generated by text-to-speech systems instead of real speech. Intonation evaluation system calculates scores between a learner's utterance and corresponding utterances by the teachers. We investigated a method of combining multiple scores. In addition, we incorporated a feature for rhythm evaluation into intonation evaluation. As a result, we obtained improvement of correlation between scores by human evaluators and the system. Furthermore, we analyzed a tendency of intonation evaluation by the system through limiting evaluation utterances to find out what degrades the system performance.

Original languageEnglish
Title of host publication2008 International Conference on Natural Language Processing and Knowledge Engineering, NLP-KE 2008
DOIs
Publication statusPublished - 2008 Dec 1
Event2008 International Conference on Natural Language Processing and Knowledge Engineering, NLP-KE 2008 - Beijing, China
Duration: 2008 Oct 192008 Oct 22

Publication series

Name2008 International Conference on Natural Language Processing and Knowledge Engineering, NLP-KE 2008

Other

Other2008 International Conference on Natural Language Processing and Knowledge Engineering, NLP-KE 2008
CountryChina
CityBeijing
Period08/10/1908/10/22

Keywords

  • CALL
  • Intonation
  • Mahalanobis distance
  • Multiple regression
  • Prosody

ASJC Scopus subject areas

  • Artificial Intelligence
  • Software

Cite this