Smartphone-based 360? video streaming/viewing system including acoustic immersion

Kenta Niwa, Daisuke Ochi, Akio Kameda, Yutaka Kamamoto, Takehiro Moriya

Research output: Contribution to conferencePaper

3 Citations (Scopus)

Abstract

In virtual reality (VR), 360? video services provided through head mounted displays (HMDs) or smartphones are widely used. Despite the fact that the user's viewpoint seamlessly changes, sounds through the headphones are fixed even when images change in correspondence with user head motion in many 360 ? video services. We have been studying acoustic immersion technology that is achieved by, for example, generating binaural sounds corresponding to the user head motion. Basically, our method is composed of angular region-wise source enhancement using array observation signals, multichannel audio encoding based on MPEG-4 Audio Lossless Coding (ALS), and binaural synthesizing of enhanced signals using head related transfer functions (HRTFs). In this paper, we constructed a smartphone-based real-Time system for streaming/viewing 360 ? video including acoustic immersion and evaluated it through subjective tests.

Original languageEnglish
Publication statusPublished - 2016
Event141st Audio Engineering Society International Convention 2016, AES 2016 - Los Angeles, United States
Duration: 2016 Sep 292016 Oct 2

Other

Other141st Audio Engineering Society International Convention 2016, AES 2016
CountryUnited States
CityLos Angeles
Period16/9/2916/10/2

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Modelling and Simulation
  • Acoustics and Ultrasonics

Fingerprint Dive into the research topics of 'Smartphone-based 360? video streaming/viewing system including acoustic immersion'. Together they form a unique fingerprint.

  • Cite this

    Niwa, K., Ochi, D., Kameda, A., Kamamoto, Y., & Moriya, T. (2016). Smartphone-based 360? video streaming/viewing system including acoustic immersion. Paper presented at 141st Audio Engineering Society International Convention 2016, AES 2016, Los Angeles, United States.