Video-rate video inpainting

Rito Murase, Yan Zhang, Takayuki Okatani

研究成果: Conference contribution

2 被引用数 (Scopus)

抄録

This paper considers the problem of video inpainting, i.e., to remove specified objects from an input video. Many methods have been developed for the problem so far, in which there is a trade-off between image quality and computational time. There was no method that can generate high-quality images in video rate. The key to video inpainting is how to establish correspondences from scene regions occluded in a frame to those observed in other frames. To break the trade-off, we propose to use CNNs as a solution to this key problem. We extend existing CNNs for the standard task of optical flow estimation to be able to estimate the flow of occluded background regions. The extension includes augmentation of their architecture and changes of their training method. We experimentally show that this approach works well despite its simplicity, and that a simple video inpainting method integrating this flow estimator runs in video rate (e.g., 32 fps for 832 × 448 pixel videos on a standard PC with a GPU) while achieving image quality close to the state-of-the-art.

本文言語English
ホスト出版物のタイトルProceedings - 2019 IEEE Winter Conference on Applications of Computer Vision, WACV 2019
出版社Institute of Electrical and Electronics Engineers Inc.
ページ1553-1561
ページ数9
ISBN(電子版)9781728119755
DOI
出版ステータスPublished - 2019 3 4
イベント19th IEEE Winter Conference on Applications of Computer Vision, WACV 2019 - Waikoloa Village, United States
継続期間: 2019 1 72019 1 11

出版物シリーズ

名前Proceedings - 2019 IEEE Winter Conference on Applications of Computer Vision, WACV 2019

Conference

Conference19th IEEE Winter Conference on Applications of Computer Vision, WACV 2019
CountryUnited States
CityWaikoloa Village
Period19/1/719/1/11

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Computer Science Applications

フィンガープリント 「Video-rate video inpainting」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル