Search papers, labs, and topics across Lattice.
This paper hybridizes equilibrium propagation (EP) with Ising machine dynamics to enhance energy-based learning efficiency in deep neural networks. By replacing the conventional dissipative Hopfield relaxation with an extended phase-space dynamics, the proposed framework mitigates local minima convergence issues inherent in EP. The results demonstrate that this new approach not only accelerates convergence and improves noise robustness but also achieves performance on benchmark datasets comparable to traditional backpropagation methods.
Lowering energy barriers in neural training could revolutionize how we approach deep learning efficiency, achieving backpropagation-level performance with significantly reduced energy costs.
The rapid evolution of artificial intelligence has led to substantial advances in deep neural networks. Nonetheless, conventional GPU-based training remains highly energy-demanding, motivating the exploration of physical dynamics and compatible energy-based learning schemes, such as equilibrium propagation (EP). EP-based training, however, frequently suffers from convergence to local minima due to phase-space contraction. Here we introduce an Ising-dynamics-inspired equilibrium-propagation framework in which dissipative Hopfield relaxation is replaced by an extended phase-space dynamics with conjugate variables. The resulting training paradigm keeps the local two-phase learning rule of EP while changing the physical route by which neural states reach equilibrium. We show that this dynamics lowers effective energy barriers, accelerates convergence, improves noise robustness, and trains deep convolutional Hopfield networks on MNIST, FashionMNIST, and CIFAR-10 with performance comparable to backpropagation.
