A tone-modeling technique using a quantized F0 context to improve tone correctness in average-voice-based speech synthesis

Vataya Chunwijitra, Takashi Nose, Takao Kobayashi

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

This paper proposes a technique of improving tone correctness in speech synthesis of a tonal language based on an average-voice model trained with a corpus from nonprofessional speakers' speech. We focused on reducing tone disagreements in speech data acquired from nonprofessional speakers without manually modifying the labels. To reduce the distortion in tone caused by inconsistent tonal labeling, quantized F0 symbols were utilized as the context for F0 to obtain an appropriate F0 model. With this technique, the tonal context could be directly extracted from the original speech and this prevented inconsistency between speech data and F0 labels generated from transcriptions, which affect naturalness and the tone correctness in synthetic speech. We examined two types of labeling for the tonal context using phone-based and sub-phone-based quantized F0 symbols. Subjective and objective evaluations of the synthetic voice were carried out in terms of the intelligibility of tone and its naturalness. The experimental results from both the objective and subjective tests revealed that the proposed technique could improve not only naturalness but also the tone correctness of synthetic speech under conditions where a small amount of speech data from nonprofessional target speakers was used.

Original languageEnglish
Pages (from-to)245-255
Number of pages11
JournalSpeech Communication
Volume54
Issue number2
DOIs
Publication statusPublished - 2012 Feb 1
Externally publishedYes

Keywords

  • Average voice model
  • F0 modeling
  • F0 quantization
  • HMM-based speech synthesis

ASJC Scopus subject areas

  • Software
  • Modelling and Simulation
  • Communication
  • Language and Linguistics
  • Linguistics and Language
  • Computer Vision and Pattern Recognition
  • Computer Science Applications

Fingerprint Dive into the research topics of 'A tone-modeling technique using a quantized F0 context to improve tone correctness in average-voice-based speech synthesis'. Together they form a unique fingerprint.

  • Cite this