An intuitive style control technique in HMM-based expressive speech synthesis using subjective style intensity and multiple-regression global variance model

Takashi Nose, Takao Kobayashi

Research output: Contribution to journalArticle

15 Citations (Scopus)

Abstract

To control intuitively the intensities of emotional expressions and speaking styles for synthetic speech, we introduce subjective style intensities and multiple-regression global variance (MRGV) models into hidden Markov model (HMM)-based expressive speech synthesis. A problem in the conventional parametric style modeling and style control techniques is that the intensities of styles appearing in synthetic speech strongly depend on the training data. To alleviate this problem, the proposed technique explicitly takes into account subjective style intensities perceived for respective training utterances using multiple-regression hidden semi-Markov models (MRHSMMs). As a result, synthetic speech becomes less sensitive to the variation of style expressivity existing in the training data. Another problem is that the synthetic speech generally suffers from the over-smoothing effect of model parameters in the model training, so the variance of the generated speech parameter trajectory becomes smaller than that of the natural speech. To alleviate this problem for the case of style control, we extend the conventional variance compensation method based on a GV model for a single-style speech to the case of multiple styles with variable style intensities by deriving the MRGV modeling. The objective and subjective experimental results show that these two techniques significantly enhance the intuitive style control of synthetic speech, which is essential for the speech synthesis system to communicate para-linguistic information correctly to the listeners.

Original languageEnglish
Pages (from-to)347-357
Number of pages11
JournalSpeech Communication
Volume55
Issue number2
DOIs
Publication statusPublished - 2013 Feb 1
Externally publishedYes

Keywords

  • HMM-based expressive speech synthesis
  • Multiple-regression HSMM
  • Multiple-regression global variance model
  • Style control
  • Style intensity

ASJC Scopus subject areas

  • Software
  • Modelling and Simulation
  • Communication
  • Language and Linguistics
  • Linguistics and Language
  • Computer Vision and Pattern Recognition
  • Computer Science Applications

Fingerprint Dive into the research topics of 'An intuitive style control technique in HMM-based expressive speech synthesis using subjective style intensity and multiple-regression global variance model'. Together they form a unique fingerprint.

  • Cite this