Search papers, labs, and topics across Lattice.
This paper introduces a superhuman AI agent for the real-time strategy game Generals.io, achieving the top rank on a public leaderboard of over 5,000 players after just four days of training on high-performance GPUs. The agent's success is attributed to a JAX-native simulator that accelerates training by approximately 10,000 times compared to previous methods, enabling extensive self-play reinforcement learning with a vision transformer policy. Key results show the agent's dominance in head-to-head matches against top human players, underscoring the importance of fast simulation in overcoming data bottlenecks in AI training.
A superhuman AI agent for Generals.io not only dominates the leaderboard but also reveals the critical role of fast simulation in achieving high performance in complex strategy games.
We present a superhuman AI agent for Generals.io, a real-time strategy game that requires both long-horizon planning and short-term tactics under strong imperfect information. Trained for four days on 4x NVIDIA H200 GPUs, our agent reaches #1 on the public 1v1 leaderboard of over 5,000 human players, leading the second-ranked player by the same margin that separates second place from 25th, and beats the two top-ranked humans head-to-head with a combined 199-70 record across 269 ladder matches. A key enabler is a JAX-native simulator that reaches tens of millions of frames per second on a single GPU, roughly a 10,000x speedup over the prior simulator. On top of this, we train a vision transformer policy end-to-end by self-play with a policy-gradient loop and sparse win/loss reward, using top-advantage sample filtering and an exponential moving average of the policy parameters. Taken together, our findings highlight what matters, and what does not, once a fast simulator removes the data bottleneck.
