Search papers, labs, and topics across Lattice.
StratFormer, a transformer-based meta-agent, learns to model and exploit opponents in imperfect-information games using a two-phase curriculum: first modeling opponent behavior while playing a game-theoretic optimal (GTO) policy, then shifting towards best-response (BR) exploitation. The architecture uses dual-turn tokens and bucket-rate features to encode opponent tendencies. Experiments on Leduc Hold'em demonstrate an average exploitation gain of +0.106 BB per hand over GTO, reaching +0.821 against highly exploitable opponents, while preserving near-equilibrium safety.
Achieve superhuman performance in imperfect-information games by learning to exploit opponent weaknesses with a transformer-based meta-agent, without sacrificing equilibrium safety.
We present StratFormer, a transformer-based meta-agent that learns to simultaneously model and exploit opponents in imperfect-information games through a two-phase curriculum. The first phase trains an opponent modeling head to identify behavioral patterns from action histories while the agent plays a game-theoretic optimal (GTO) policy. The second phase progressively shifts the policy toward best-response (BR) exploitation, guided by a per-opponent regularization schedule tied to exploitability. Our architecture introduces dual-turn tokens -- feature vectors constructed at both agent and opponent decision points -- coupled with bucket-rate features that encode opponent tendencies across five strategic contexts. On Leduc Hold'em, a small poker variant with six cards and two betting rounds, we test against six opponent archetypes at two strength levels each, with exploitability ranging from 0.15 to 1.26 Big Blinds (BB) per hand. StratFormer achieves an average exploitation gain of +0.106 BB per hand over GTO, with peak gains of +0.821 against highly exploitable opponents, while maintaining near-equilibrium safety.
