Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
We introduce a transformer-based variational autoregressive network, incorporating locality-informed attention and approximate probabilities, for sampling continuous-degree-of-freedom lattice systems. This approach is applied to the 2D XY model near its BKT transition, demonstrating superior performance over existing neural samplers. The trained model, validated on lattices up to $96\times96$ with a mode-dropping estimator, accurately reproduces key physical observables like energy and magnetization.
Transformer-based samplers achieve state-of-the-art performance on continuous lattice models, outperforming traditional MCMC and prior neural methods.
We present a transformer-based variational autoregressive network for sampling lattice systems with continuous degrees of freedom and apply it to the two-dimensional XY model near the Berezinskii-Kosterlitz-Thouless transition. The architecture is combined with physics-informed ingredients: locality-informed attention and approximate probabilities. The resulting sampler significantly outperforms existing neural samplers. We train the model on lattices up to $96\times96$, verify with a mode-dropping estimator that no parts of the configuration space are missed, and reproduce the energy, magnetization and helicity modulus obtained with the traditional Markov Chain Monte Carlo algorithm.