Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper extends the delocalization of bias phenomenon to unadjusted Hamiltonian Monte Carlo and underdamped Langevin algorithms, showing that controlling the $W_2$ bias of any $K$-dimensional marginal in high-dimensional distributions can be achieved with $O(\sqrt{K})$ integration steps. The authors address the technical challenges posed by discrete-time integrators through a matrix-polynomial framework that characterizes their propagators. Notably, their findings suggest that the Leimkuhler-Matthews integrator for overdamped Langevin dynamics also benefits from this delocalization effect, broadening the applicability of their results.
Achieving bias control in high-dimensional distributions with significantly fewer integration steps could revolutionize sampling efficiency in complex models.
Unadjusted samplers such as unadjusted Hamiltonian Monte Carlo and underdamped Langevin are well-known to be biased. Metropolis--Hastings adjustment has been conventionally incorporated into Hamiltonian Monte Carlo to eliminate the bias. However, this adjustment can significantly increase the iteration complexity due to the small step size required for reasonable Metropolis acceptance rates. In this work, we extend the \emph{delocalization of bias} phenomenon, previously established for the overdamped Langevin algorithm, to these two unadjusted algorithms. We show that to control the $W_2$ bias of any $K$-dimensional marginal of a high-dimensional distribution, $O(\sqrt{K})$ integration steps suffice up to $\log d$ terms, assuming either weak or sparse interactions among variables. The discrete-time integrators here introduce technical difficulties beyond those of the overdamped setting, which we address through a broadly applicable matrix-polynomial framework that characterizes their propagators. Our result for the underdamped Langevin algorithm is valid for all large friction parameters, implying that the Leimkuhler-Matthews integrator for the overdamped Langevin dynamics also exhibits delocalization of bias.