Analysis of cost function based on Kullback–Leibler divergence in independent component analysis for two uniformly distributed source signals

Kota Tanzawa, Shunsuke Koshita, Masahide Abe, Masayuki Kawamata

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

Independent component analysis plays a central role in blind source separation, leading to many applications of signal processing such as telecommunications, speech processing, and biomedical signal processing. Although the independent component analysis requires cost functions for evaluation of mutual independence of observed signals, little has been reported on theoretical investigation of the characteristics of such cost functions. In this paper, we mathematically analyze the cost function based on Kullback–Leibler divergence in independent component analysis. Our analysis proves that the cost function becomes unimodal when the number of source signals is two and both of the source signals have uniform distributions. In order to derive this result, we make use of whitening of observed signals and we describe the cost function in closed form.

Original languageEnglish
Pages (from-to)37-42
Number of pages6
JournalElectronics and Communications in Japan
Volume101
Issue number8
DOIs
Publication statusPublished - 2018 Aug

Keywords

  • Kullback–Leibler divergence
  • cost function
  • independent component analysis
  • uniform distribution
  • unimodality

ASJC Scopus subject areas

  • Signal Processing
  • Physics and Astronomy(all)
  • Computer Networks and Communications
  • Electrical and Electronic Engineering
  • Applied Mathematics

Fingerprint Dive into the research topics of 'Analysis of cost function based on Kullback–Leibler divergence in independent component analysis for two uniformly distributed source signals'. Together they form a unique fingerprint.

Cite this