Search papers, labs, and topics across Lattice.
This paper introduces a novel accelerated sampling method called SA-PAL, which integrates SamAdams adaptive timestepping with position-adaptive Langevin dynamics to enhance sampling efficiency in complex phase spaces. By dynamically adjusting timesteps and concentrating friction along the local force direction, the method achieves significant improvements in mixing rates and computational efficiency, requiring only a single force evaluation per iteration. Experimental results demonstrate that SA-PAL outperforms traditional fixed stepsize integration, achieving efficiency gains of over an order of magnitude in various test scenarios, including the Rosenbrock and Mueller-Brown potentials.
Mixing rates improve by 1.5-3 times with the new SA-PAL method, showcasing a dramatic leap in sampling efficiency for complex systems.
We introduce an accelerated Langevin-based sampling method that is based on two complementary devices: \emph{SamAdams} adaptive timestepping, which automatically shrinks the effective integration step in stiff regions of phase space using a relaxed stiffness monitor, and \emph{position-adaptive Langevin} (PAL) dynamics, which concentrates friction along the local force direction while preserving the canonical distribution as the exact invariant measure. The resulting combined scheme (SA-PAL) is implemented in a palindromic integrator which requires only one force evaluation per iteration through suitable organisation of the integration steps and by exploiting the rank-one-plus-scalar structure of the PAL friction tensor. We test the method on various model problems: the Rosenbrock function, a thin entropic channel, the Mueller-Brown potential, and a Bayesian parameterisation problem with a sparsity-inducing shrinkage prior. On the Rosenbrock and Mueller-Brown potentials mixing rates are improved by 1.5-3 times compared to fixed stepsize integration. Efficiency gains of more than an order of magnitude are documented in the other examples.
ETH