360° depth estimation from multiple fisheye images with origami crown representation of icosahedron

Ren Komatsu, Hiromitsu Fujii, Yusuke Tamura, Atsushi Yamashita, Hajime Asama

研究成果: Conference contribution

1 被引用数 (Scopus)

抄録

In this study, we present a method for all-around depth estimation from multiple omnidirectional images for indoor environments. In particular, we focus on plane-sweeping stereo as the method for depth estimation from the images. We propose a new icosahedron-based representation and ConvNets for omnidirectional images, which we name "CrownConv"because the representation resembles a crown made of origami. CrownConv can be applied to both fisheye images and equirect- angular images to extract features. Furthermore, we propose icosahedron-based spherical sweeping for generating the cost volume on an icosahedron from the extracted features. The cost volume is regularized using the three-dimensional CrownConv, and the final depth is obtained by depth regression from the cost volume. Our proposed method is robust to camera alignments by using the extrinsic camera parameters; therefore, it can achieve precise depth estimation even when the camera alignment differs from that in the training dataset. We evaluate the proposed model on synthetic datasets and demonstrate its effectiveness. As our proposed method is computationally efficient, the depth is estimated from four fisheye images in less than a second using a laptop with a GPU. Therefore, it is suitable for real-world robotics applications. Our source code is available at https://github.com/matsuren/crownconv360depth.

本文言語English
ホスト出版物のタイトル2020 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2020
出版社Institute of Electrical and Electronics Engineers Inc.
ページ10092-10099
ページ数8
ISBN(電子版)9781728162126
DOI
出版ステータスPublished - 2020 10 24
イベント2020 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2020 - Las Vegas, United States
継続期間: 2020 10 242021 1 24

出版物シリーズ

名前IEEE International Conference on Intelligent Robots and Systems
ISSN(印刷版)2153-0858
ISSN(電子版)2153-0866

Conference

Conference2020 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2020
国/地域United States
CityLas Vegas
Period20/10/2421/1/24

ASJC Scopus subject areas

  • 制御およびシステム工学
  • ソフトウェア
  • コンピュータ ビジョンおよびパターン認識
  • コンピュータ サイエンスの応用

フィンガープリント

「360° depth estimation from multiple fisheye images with origami crown representation of icosahedron」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル