A study on 2D photo-realistic facial animation generation using 3D facial feature points and deep neural networks

Kazuki Sato, Takashi Nose, Akira Ito, Yuya Chiba, Akinori Ito, Takahiro Shinozaki

研究成果: Conference contribution

抄録

This paper proposes a technique for generating a 2D photo-realistic facial animation from an input text. The technique is based on the mapping from 3D facial feature points with deep neural networks (DNNs). Our previous approach was based only on a 2D space using hidden Markov models (HMMs) and DNNs. However, this approach has a disadvantage that generated 2D facial pixels are sensitive to the rotation of the face in the training data. In this study, we alleviate the problem using 3D facial feature points obtained by Kinect. The information of the face shape and color is parameterized by the 3D facial feature points. The relation between the labels from texts and face-model parameters are modeled by DNNs in the model training. As a preliminary experiment, we show that the proposed technique can generate the 2D facial animation from arbitrary input texts.

本文言語English
ホスト出版物のタイトルAdvances in Intelligent Information Hiding and Multimedia Signal Processing - Proceedings of the 13th International Conference on Intelligent Information Hiding and Multimedia Signal Processing,
編集者Junzo Watada, Lakhmi C. Jain, Jeng-Shyang Pan, Pei-Wei Tsai
出版社Springer Science and Business Media Deutschland GmbH
ページ113-118
ページ数6
ISBN(印刷版)9783319638584
DOI
出版ステータスPublished - 2018 1 1
イベント13th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, IIH-MSP 2017 - Matsue, Shimane, Japan
継続期間: 2017 8 122017 8 15

出版物シリーズ

名前Smart Innovation, Systems and Technologies
82
ISSN(印刷版)2190-3018
ISSN(電子版)2190-3026

Other

Other13th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, IIH-MSP 2017
CountryJapan
CityMatsue, Shimane
Period17/8/1217/8/15

ASJC Scopus subject areas

  • Decision Sciences(all)
  • Computer Science(all)

フィンガープリント 「A study on 2D photo-realistic facial animation generation using 3D facial feature points and deep neural networks」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル