Track synthesis, materials and catalysis as it is published.
Search papers, labs, and topics across Lattice.
This paper introduces a unified method for gradient-variation regret minimization in online learning by employing surrogate losses with a quadratic penalty on decision movement. This approach establishes gradient-variation bounds for both non-stationary and universal online learning settings, unifying prior disparate techniques. The method achieves state-of-the-art regret rates in non-stationary settings via an optimistic-to-gradient-variation reduction and matches optimal universal regret bounds under relaxed assumptions, also improving guarantees for online games.
A single, unified approach to gradient-variation regret minimization unlocks state-of-the-art performance in both non-stationary and universal online learning settings.
Gradient-variation online learning has attracted increasing attention for its connections to game theory and optimization. It has been studied in both non-stationary online learning, which aims to minimize dynamic regret against time-varying comparator sequences, and universal online learning, which seeks to adapt to unknown loss curvature. Prior work obtained gradient-variation bounds using different techniques tailored to each setting. We propose a simple and unified method based on surrogate losses with a quadratic penalty on decision movement, yielding gradient-variation bounds in both settings. For non-stationary online learning, the method induces an optimistic-to-gradient-variation reduction, enabling a broad class of algorithms to match the rate established by Zhao et al. (2024). For universal online learning, it yields a simple algorithm that matches the optimal universal regret bounds of Yan et al. (2024) while relaxing the extended smoothness assumption. Finally, we apply our method to online games and improve on existing guarantees.