Synthesis of photo-realistic facial animation from text based on HMM and DNN with animation unit

研究成果: Conference contribution

1 被引用数 (Scopus)

抄録

In this paper, we propose a technique for synthesizing photorealistic facial animation from a text based on hidden Markov model (HMM) and deep neural network (DNN) with facial features for an interactive agent implementation. In the proposed technique, we use Animation Unit (AU) as facial features that express the state of each part of face and can be obtained by Kinect. We synthesize facial features from any text using the same framework as the HMM-based speech synthesis. Facial features are generated from HMM and are converted into intensities of pixels using DNN. We investigate appropriate conditions for training of HMM and DNN. Then, we perform an objective evaluation to compare the proposed technique with a conventional technique based on the principal component analysis (PCA).

本文言語English
ホスト出版物のタイトルAdvances in Intelligent Information Hiding and Multimedia Signal Processing - Proceeding of the 12th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, 2016
編集者Jeng-Shyang Pan, Pei-Wei Tsai, Hsiang-Cheh Huang
出版社Springer Science and Business Media Deutschland GmbH
ページ29-36
ページ数8
ISBN(印刷版)9783319502113
DOI
出版ステータスPublished - 2017
イベント12th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, IIH-MSP 2016 - Kaohsiung, Taiwan, Province of China
継続期間: 2016 11 212016 11 23

出版物シリーズ

名前Smart Innovation, Systems and Technologies
64
ISSN(印刷版)2190-3018
ISSN(電子版)2190-3026

Other

Other12th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, IIH-MSP 2016
国/地域Taiwan, Province of China
CityKaohsiung
Period16/11/2116/11/23

ASJC Scopus subject areas

  • 決定科学(全般)
  • コンピュータ サイエンス(全般)

フィンガープリント

「Synthesis of photo-realistic facial animation from text based on HMM and DNN with animation unit」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル