Search papers, labs, and topics across Lattice.
This paper establishes the minimax-optimal alternating regret for online learning in both online linear optimization (OLO) and online convex optimization (OCO), presenting algorithms that achieve significant improvements in regret bounds. For OLO over the probability simplex, the authors introduce an algorithm with $O(\log d)$ alternating regret, which holds constant across any time horizon $T$, outperforming previous results that had a time-dependent regret. Additionally, they demonstrate $O(\log d / T)$ convergence to Nash equilibria in two-player zero-sum games, marking a breakthrough in uncoupled learning dynamics with improved convergence rates in general-sum games.
Achieving constant alternating regret in online learning could revolutionize strategies for reaching Nash equilibria in competitive environments.
We settle the minimax-optimal alternating regret, a regret notion motivated by alternating learning dynamics in games, for both online linear optimization (OLO) and online convex optimization (OCO). For OLO over the probability simplex $螖_d$, we give an algorithm with $O(\log d)$ alternating regret that remains a constant for any time horizon $T$, and a matching lower bound. Our constant regret bound significantly improves previous results with $O(\log ^{2/3}d \cdot T^{1/3})$ regret [Cevher, Cutkosky, Kavis, Piliouras, Skoulakis, Viano, NeurIPS 2023, Hait, Li, Luo, Zhang, COLT 2025]. As a result, we obtain alternating learning dynamics with $O(\log d /T)$ convergence to Nash equilibria in two-player zero-sum games and $O(\log d /T)$ convergence to coarse correlated equilibria in two-player general-sum games. This is the first uncoupled learning dynamics with $O(1/T)$ convergence to CCE in two-player general-sum games, while all prior works suffer additional $\log T$ factors. For general OCO over a $d$-dimensional compact convex set, we give an algorithm with $O(d\log (1+T/d))$ alternating regret, improving the previous best of $\widetilde{O}(d^{2/3}T^{1/3})$. We also prove a matching lower bound of $惟(d\log (1+T/d))$, showing that the $惟(\log T)$ factor is unavoidable.