Search papers, labs, and topics across Lattice.
This paper investigates generalized linear bandits (GLB) under heavy-tailed noise, which is relevant for applications in personalized recommendations and finance. The authors introduce the EHM algorithm, which leverages online mirror descent to achieve an optimal regret of \(\widetilde{\mathcal{O}}(T^{\frac{1}{1+\epsilon}})\) with one-pass updates, eliminating the need for a commonly used parameter. Additionally, they extend their findings to piecewise constant contexts and develop the NB-EHM algorithm for nonlinear bandits, demonstrating a sublinear regret bound through an affine lifting approach.
Achieving optimal regret in generalized linear bandits with heavy-tailed noise using a novel one-pass update algorithm could revolutionize decision-making in dynamic environments.
In this paper we first study the problem of generalized linear bandit (GLB) under heavy-tailed noise. The characteristics of heavy-tailed distributions are widely observed in real-world applications such as personalized recommendation, financial markets, and medical treatments. Based on the online mirror descent (OMD) method, we propose an algorithm EHM that extends the adaptive Huber loss method (Wang et al., 2025) with one-pass update ($\mathcal{O}(1)$ computational complexity with respect to current round $t$ and the time horizon $T$), which simultaneously achieves an almost optimal regret of $\widetilde{\mathcal{O}}(T^{\frac{1}{1+蔚}})$ where $T$ is the time horizon. In addition, by utilizing a special property of some link function (Sawarni et al., 2025), our algorithm eliminates the need to know a commonly used parameter. Next, we study the GLB problem under the case when contextual characteristic becomes piecewise constant, and we slightly revised former algorithm to obtain the PGLB-EHM algorithm. After theoretical analysis, we prove that the regret upper bound order stays the same. Furthermore, we look deeper into a special case of nonlinear bandit (NB) and present the NB-EHM algorithm with bisection method and special restriction. Eventually we utilize the affine lifting approach and show that the general NB problem can be applied with NB-EHM to achieve a sublinear regret bound.
