Statistical analysis of the expectation-maximization algorithm with loopy belief propagation in Bayesian image modeling

Shun Kataoka, Muneki Yasuda, Kazuyuki Tanaka, D. M. Titterington

Research output: Contribution to journalArticlepeer-review

3 Citations (Scopus)

Abstract

New statistical approaches to hyperparameter estimation by means of the expectation-maximization (EM) algorithm and loopy belief propagation (LBP) are given for Bayesian image modeling from the standpoint of statistical-mechanical informatics. In the present paper, we give a new scheme for computing the average of the trajectory in the EM algorithm with LBP with respect to all the possible degraded images generated by the assumed degradation process from a given original image. Moreover, we also give a new scheme for computing the average of the trajectory in the EM algorithm with LBP with respect to all the possible original images generated by the assumed prior probability distribution. Bayesian image models for binary image restorations are constructed as Ising models with random external fields and spatially uniform nearest-neighbor interactions on the square lattice. Our schemes for computing the above random averages for some statistical quantities in LBP are constructed by means of the Bethe approximation for random spin systems. They are reduced to the solution of simultaneous integral equations for distributions of messages in LBP. We show the results of some numerical experiments in LBP as well as the statistical analysis of the trajectory in the EM algorithm for binary image restoration by LBP.

Original languageEnglish
Pages (from-to)50-63
Number of pages14
JournalPhilosophical Magazine
Volume92
Issue number1-3
DOIs
Publication statusPublished - 2012 Jan 1

Keywords

  • Bayesian statistics
  • Bethe approximation
  • EM algorithm
  • Markov random fields
  • loopy belief propagation
  • maximum likelihood estimation
  • probabilistic image processing

ASJC Scopus subject areas

  • Condensed Matter Physics

Fingerprint Dive into the research topics of 'Statistical analysis of the expectation-maximization algorithm with loopy belief propagation in Bayesian image modeling'. Together they form a unique fingerprint.

Cite this