Tomasz Stebel

Transformer-based neural samplers now achieve state-of-the-art performance on continuous lattice models, matching traditional MCMC accuracy.

Transformers, typically considered inefficient for spin system sampling, can now outperform CNN-based samplers by generating groups of spins, unlocking larger system sizes and higher effective sample sizes.