Creating multi-viewpoint panoramas of streets with sparsely located buildings

Takayuki Okatani, Jun Yanagisawa, Daiki Tetsuka, Ken Sakurada, Koichiro Deguchi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a method for creating multi-viewpoint panoramas that is particularly targeted at streets with sparsely located buildings. As is known in the literature, it is impossible to create panoramas of such scenes having a wide range of depths in a distortion-free manner. To overcome this difficulty, our method renders sharp images only for the facades of buildings and the ground surface (e.g., vacant lands and sidewalks) along the target streets; it renders blurry images for other objects in the scene to make their geometric distortion less noticeable while maintaining their presence. To perform these, our method first estimates the three-dimensional structures of the target scenes using the results obtained by SfM (structure from motion), identifies to which category (i.e., the facade surface, the ground surface, or other objects) each scene point belongs based on MRF (Markov Random Field) optimization, and creates panoramic images of the scene by mosaicing the images of the three categories. The blurry images of objects are generated by a similar technique to digital refocus of the light field photography. We present several panoramic images created by our method for streets in the tsunami-devastated areas in the north-eastern Japan coastline because of the Great East Japan Earthquake of March 11, 2011.

Original languageEnglish
Title of host publicationField and Service Robotics - Results of the 8th International Conference
Pages65-79
Number of pages15
DOIs
Publication statusPublished - 2014 Mar 11
Event8th International Conference on Field and Service Robotics, FSR 2012 - Matsushima, Miyagi, Japan
Duration: 2012 Jul 162012 Jul 19

Publication series

NameSpringer Tracts in Advanced Robotics
Volume92
ISSN (Print)1610-7438
ISSN (Electronic)1610-742X

Other

Other8th International Conference on Field and Service Robotics, FSR 2012
CountryJapan
CityMatsushima, Miyagi
Period12/7/1612/7/19

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Creating multi-viewpoint panoramas of streets with sparsely located buildings'. Together they form a unique fingerprint.

  • Cite this

    Okatani, T., Yanagisawa, J., Tetsuka, D., Sakurada, K., & Deguchi, K. (2014). Creating multi-viewpoint panoramas of streets with sparsely located buildings. In Field and Service Robotics - Results of the 8th International Conference (pp. 65-79). (Springer Tracts in Advanced Robotics; Vol. 92). https://doi.org/10.1007/978-3-642-40686-7_5