TY - JOUR

T1 - Retrieval dynamics of associative memory of the Hopfield type

AU - Nishimori, H.

AU - Ozeki, T.

PY - 1993/12/1

Y1 - 1993/12/1

N2 - The authors have investigated the dynamics of retrieval processes of an associative memory of the Hopfield type (1982). For synchronous dynamics, they have generalized the theory of Amari and Maginu (1988), which enables them to treat the intermediate processes of memory retrieval in terms of a few simple macrovariables to the finite-temperature case. The resulting phase diagram in the equilibrium limit agrees qualitatively well with that from equilibrium statistical mechanics. They have carried out Monte Carlo simulations to clarify the limit of applicability of their theory. They have found that their basic assumption, an independent Gaussian distribution of the noise term with a time-dependent variance, is satisfied if the network succeeds in retrieval. When retrieval fails, the distribution of noise is non-Gaussian from very early stages of time development. For asynchronous dynamics, they propose a time-dependent Ginzburg-Landau approach, which simply expresses a downhill motion of the network in the free energy landscape. The resulting flow diagram in a phase space describes the behaviour of the network when it is close to equilibrium.

AB - The authors have investigated the dynamics of retrieval processes of an associative memory of the Hopfield type (1982). For synchronous dynamics, they have generalized the theory of Amari and Maginu (1988), which enables them to treat the intermediate processes of memory retrieval in terms of a few simple macrovariables to the finite-temperature case. The resulting phase diagram in the equilibrium limit agrees qualitatively well with that from equilibrium statistical mechanics. They have carried out Monte Carlo simulations to clarify the limit of applicability of their theory. They have found that their basic assumption, an independent Gaussian distribution of the noise term with a time-dependent variance, is satisfied if the network succeeds in retrieval. When retrieval fails, the distribution of noise is non-Gaussian from very early stages of time development. For asynchronous dynamics, they propose a time-dependent Ginzburg-Landau approach, which simply expresses a downhill motion of the network in the free energy landscape. The resulting flow diagram in a phase space describes the behaviour of the network when it is close to equilibrium.

UR - http://www.scopus.com/inward/record.url?scp=21144476369&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=21144476369&partnerID=8YFLogxK

U2 - 10.1088/0305-4470/26/4/013

DO - 10.1088/0305-4470/26/4/013

M3 - Article

AN - SCOPUS:21144476369

VL - 26

SP - 859

EP - 871

JO - Journal of Physics A: Mathematical and Theoretical

JF - Journal of Physics A: Mathematical and Theoretical

SN - 1751-8113

IS - 4

M1 - 013

ER -