Search papers, labs, and topics across Lattice.
This paper employs large deviations theory to derive a general expression for the free energy functional of dense associative memories, including the classical Hopfield model. By focusing on finite patterns, the authors establish a temperature-dependent free energy functional and evaluate the disorder-averaged ground-state energy in extensive limits. The findings reveal critical insights into memory retrieval dynamics in higher-order dense networks and provide an exact full-retrieval threshold for the Log-Sum-Exponential model, enhancing the analytical framework for complex associative memory architectures.
Memory retrieval in dense networks hinges on initial states, with the exact full-retrieval threshold for the LSE model now clearly defined.
Using large deviations theory, we solve and obtain a general expression for the free energy functional for a broad class of associative memories, including dense associative memories. We illustrate the method by reproducing classical results for the Hopfield model. For a finite number of patterns, we derive the temperature-dependent free energy functional for dense associative memories featuring polynomial interactions and Log-Sum-Exponential (LSE) activation. We also evaluate the disorder-averaged ground-state energy of these systems in the extensive limit. Our analytical framework reveals how memory retrieval depends on the initial state in higher-order dense networks, and gives the exact full-retrieval threshold for the LSE model. This method provides a systematic procedure for analyzing diverse, complex architectures in associative memory.
