Improving human scoring of prosody using parametric speech synthesis

Hafiyan Prafianto, Takashi Nose, Yuya Chiba, Akinori Ito

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

This paper proposes a method that utilizes parametric speech synthesis to improve human scoring of non-native speaker utterances. Instead of assessing each prosodic feature by directly listening to the utterance itself, in order to focus only on the target prosodic feature, the unassessed features are substituted with those of the native speakers. We used parametric speech synthesis to generate the features for substitution. In this study, HMM-based speech synthesis from an average model of native speakers was utilized. The experimental result shows that the proposed method can improve scoring reliability, which is confirmed by an increase in the inter-rater correlation. We also build an automatic pronunciation evaluation system trained from non-native speech databases with scores given by either the conventional and proposed methods, and compare the performance of the systems. The result shows that the predicted pronunciation scores matched the human-rated scores; the human-machine correlation produced a score of 0.87, while the conventional scoring method produced a score of 0.74.

Original languageEnglish
Pages (from-to)14-21
Number of pages8
JournalSpeech Communication
Volume111
DOIs
Publication statusPublished - 2019 Aug

Keywords

  • Automatic pronunciation evaluation system
  • Average voice model
  • Computer assisted language learning (CALL)
  • Computer assisted pronunciation training (CAPT)
  • Parametric speech synthesis

ASJC Scopus subject areas

  • Software
  • Modelling and Simulation
  • Communication
  • Language and Linguistics
  • Linguistics and Language
  • Computer Vision and Pattern Recognition
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'Improving human scoring of prosody using parametric speech synthesis'. Together they form a unique fingerprint.

Cite this