Search papers, labs, and topics across Lattice.
FootsiesGym is an open-source environment designed for studying two-player, zero-sum, imperfect-information games, specifically focusing on the strategic interactions present in the minimalist 2D fighting game Footsies. The environment allows for high-throughput training of reinforcement learning algorithms through its vectorized simulator, making it both accessible and reproducible for researchers. Benchmarking various RL algorithms reveals the unique challenges posed by cyclic, non-transitive strategies, paving the way for future research in game theory and AI training methodologies.
FootsiesGym reveals the complexities of imperfect-information games, providing a novel benchmark that challenges conventional RL strategies.
We present FootsiesGym, an open-source environment for learning in a non-trivial two-player, zero-sum, imperfect-information game. Built on HiFight's minimalist 2D fighting game Footsies, it isolates the cyclic, non-transitive strategic interactions of fighting game neutral play while remaining simple enough for efficient analysis. We provide a vectorized simulator that enables high-throughput training on standard hardware, making the environment accessible and reproducible. We describe the design of the environment, benchmark several reinforcement learning algorithms, and discuss open research directions it enables. The code is available at https://github.com/como-research/FootsiesGym.
