Search papers, labs, and topics across Lattice.
This paper analyzes the mixing time of the alternating-scan sampler for positively weighted restricted Boltzmann machines (RBMs), a class of undirected probabilistic graphical models. By drawing connections to the Glauber dynamics of ferromagnetic two-spin systems, the authors derive polylogarithmic mixing time bounds. These bounds hold up to the critical thresholds, improving our understanding of the convergence properties of sampling algorithms for RBMs.
Positively weighted RBMs, foundational models in unsupervised learning, can now be sampled efficiently, with provable polylogarithmic mixing times.
We show polylogarithmic mixing time bounds for the alternating-scan sampler for positively weighted restricted Boltzmann machines. This is done via analysing the same chain and the Glauber dynamics for ferromagnetic two-spin systems, where we obtain new mixing time bounds up to the critical thresholds.