Theoretical study of hyperparameter estimation by maximization of marginal likelihood in image restoration by means of cluster variation method

Research output: Contribution to journalArticlepeer-review

4 Citations (Scopus)

Abstract

From the perspective of maximum likelihood estimation, the hyperparameters that appear in the statistical methods for image restoration are determined by maximizing the quantity referred to as the marginal likelihood. Rigorously calculating the marginal likelihood for the Markov random field model is extremely difficult, and approximate analysis techniques must be introduced. A well-known conventional approximate analysis technique is mean field approximation. In this paper, we propose a novel approximate analysis technique that uses the cluster variation method instead of mean field approximation to more accurately estimate hyperparameters than estimation using the marginal likelihood. The cluster variation method is a typical approximate analysis technique in statistical mechanics obtained by extending mean field approximation and can obtain some statistical quantities of the Markov random field model with high accuracy. However, the cluster variation method has not been applied to hyperparameter estimation employing the marginal likelihood. Compared to the results of earlier mean field approximation often used as the marginal likelihood approximate analysis technique, numerical experiments show that hyperparameter estimation using the cluster variation method produces better restorations particularly of images that closely reflect the prior probability distribution.

Original languageEnglish
Pages (from-to)50-62
Number of pages13
JournalElectronics and Communications in Japan, Part III: Fundamental Electronic Science (English translation of Denshi Tsushin Gakkai Ronbunshi)
Volume85
Issue number7
DOIs
Publication statusPublished - 2002 Jul 1

Keywords

  • Bayesian statistics
  • Cluster variation method
  • Image restoration
  • Marginal likelihood
  • Markov random fields
  • Mean field theory
  • Statistical techniques

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Theoretical study of hyperparameter estimation by maximization of marginal likelihood in image restoration by means of cluster variation method'. Together they form a unique fingerprint.

Cite this