Track synthesis, materials and catalysis as it is published.
Search papers, labs, and topics across Lattice.
We establish linear convergence rates for the last iterate of Optimistic Follow-The-Regularized-Leader (OFTRL) to a Nash equilibrium in multiplayer harmonic games, a class of games with broad applications. This convergence is achieved under a mild game-regularity condition and holds for a diverse set of regularizers, including entropy and Tsallis. The proof leverages a dual perspective, demonstrating how optimism and game structure drive the dissipation of an energy function with tight quantitative bounds.
Optimistic FTRL achieves linear convergence to Nash equilibria in harmonic games, a significant improvement over prior sublinear bounds.
We prove that the last iterate of Optimistic Follow-The-Regularized-Leader (OFTRL) converges at a linear rate to a Nash equilibrium in multiplayer harmonic games. Our result holds under a mild game-regularity condition and for a large family of regularizers, including entropy, Tsallis, and log-barrier. Our analysis is based on a dual perspective of OFTRL: we prove that the interaction between optimism and the global structure of harmonic games leads to the dissipation of an energy function along the dual iterates, for which we establish tight quantitative bounds. Our result also holds for the Extragradient FTRL variant.
DeepMind
Google Research