DNN-based talking movie generation with face direction consideration

Toru Ishikawa, Takashi Nose, Akinori Ito

研究成果: Conference contribution

抄録

In this paper, we propose a method to generate a talking head animation considering the direction of the face. The proposed method parametrizes a facial image using the active appearance model (AAM) and models the parameters of the AAM using a feedforward deep neural network. Since the AAM is a two-dimensional face model, conventional methods that use the AAM assumes only the frontal face. Thus, when combining the generated face and other parts such as a head and a body, the direction of the face and the head was often inconsistent. The proposed method models the shape parameters of the AAM using the principal component analysis (PCA) so that the direction and movement of individual facial parts are modeled separately; thus we substitute the face direction of the generated animation with that of the head part so that the direction of the face and the head coincides. We conducted an experiment to demonstrate that the proposed method can generate face animation with proper face direction.

本文言語English
ホスト出版物のタイトルRecent Advances in Intelligent Information Hiding and Multimedia Signal Processing - Proceeding of the Fourteenth International Conference on Intelligent Information Hiding and Multimedia Signal Processing
編集者Lakhmi C. Jain, Lakhmi C. Jain, Pei-Wei Tsai, Akinori Ito, Jeng-Shyang Pan, Lakhmi C. Jain
出版社Springer Science and Business Media Deutschland GmbH
ページ157-164
ページ数8
ISBN(印刷版)9783030037475
DOI
出版ステータスPublished - 2019
イベント14th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, IIH-MSP 2018 - Sendai, Japan
継続期間: 2018 11 262018 11 28

出版物シリーズ

名前Smart Innovation, Systems and Technologies
110
ISSN(印刷版)2190-3018
ISSN(電子版)2190-3026

Other

Other14th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, IIH-MSP 2018
CountryJapan
CitySendai
Period18/11/2618/11/28

ASJC Scopus subject areas

  • Decision Sciences(all)
  • Computer Science(all)

フィンガープリント 「DNN-based talking movie generation with face direction consideration」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル