D. Zapolski

Transformer-based samplers achieve state-of-the-art performance on continuous lattice models, outperforming traditional MCMC and prior neural methods.

Transformers, typically considered inefficient for spin system sampling, can now outperform CNN-based samplers by generating groups of spins, unlocking larger system sizes and higher effective sample sizes.