Statistical mechanics of lossy data compression using a nonmonotonic perceptron

Tadaaki Hosaka, Yoshiyuki Kabashima, Hidetoshi Nishimori

Research output: Contribution to journalArticlepeer-review

30 Citations (Scopus)


The performance of a lossy data compression scheme for uniformly biased Boolean messages is investigated via methods of statistical mechanics. Inspired by a formal similarity to the storage capacity problem in neural network research, we utilize a perceptron of which the transfer function is appropriately designed in order to compress and decode the messages. Employing the replica method, we analytically show that our scheme can achieve the optimal performance known in the framework of lossy compression in most cases when the code length becomes infinite. The validity of the obtained results is numerically confirmed.

Original languageEnglish
Number of pages1
JournalPhysical Review E - Statistical Physics, Plasmas, Fluids, and Related Interdisciplinary Topics
Issue number6
Publication statusPublished - 2002 Dec 18
Externally publishedYes

ASJC Scopus subject areas

  • Statistical and Nonlinear Physics
  • Mathematical Physics
  • Condensed Matter Physics
  • Physics and Astronomy(all)


Dive into the research topics of 'Statistical mechanics of lossy data compression using a nonmonotonic perceptron'. Together they form a unique fingerprint.

Cite this