TY - JOUR

T1 - Finite-dimensional neural networks storing structured patterns

AU - Nishimori, Hidetoshi

AU - Whyte, W.

AU - Sherrington, D.

PY - 1995

Y1 - 1995

N2 - We investigate thermodynamic properties of neural networks defined on a finite-dimensional lattice designed to store and retrieve patterns with structure. Our aim is to draw phase diagrams with axes of temperature and a parameter controlling the structure of patterns. Gauge symmetry is used to derive various exact or rigorous results on the properties of the system. These results put strong constraints on the possible phase diagrams. We also use Peierls arguments to prove the existence of a ferromagnetic phase and of a phase with finite overlap order in certain regions of the phase diagram. Our conclusion on the phase diagram is that, first, if the number of embedded patterns is smaller than a critical value, the system has in general three phases: a paramagnetic phase, a retrieval phase, and a ferromagnetic phase accompanied by finite overlap order. For larger numbers of embedded patterns, a ferromagnetic phase without overlap order appears in addition. The retrieval phase without ferromagnetic order may be replaced by a spin glass phase for large numbers of embedded patterns.

AB - We investigate thermodynamic properties of neural networks defined on a finite-dimensional lattice designed to store and retrieve patterns with structure. Our aim is to draw phase diagrams with axes of temperature and a parameter controlling the structure of patterns. Gauge symmetry is used to derive various exact or rigorous results on the properties of the system. These results put strong constraints on the possible phase diagrams. We also use Peierls arguments to prove the existence of a ferromagnetic phase and of a phase with finite overlap order in certain regions of the phase diagram. Our conclusion on the phase diagram is that, first, if the number of embedded patterns is smaller than a critical value, the system has in general three phases: a paramagnetic phase, a retrieval phase, and a ferromagnetic phase accompanied by finite overlap order. For larger numbers of embedded patterns, a ferromagnetic phase without overlap order appears in addition. The retrieval phase without ferromagnetic order may be replaced by a spin glass phase for large numbers of embedded patterns.

UR - http://www.scopus.com/inward/record.url?scp=0008238534&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0008238534&partnerID=8YFLogxK

U2 - 10.1103/PhysRevE.51.3628

DO - 10.1103/PhysRevE.51.3628

M3 - Article

AN - SCOPUS:0008238534

VL - 51

SP - 3628

EP - 3642

JO - Physical Review E

JF - Physical Review E

SN - 2470-0045

IS - 4

ER -