Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper addresses the extensive-form bandit problem by developing an algorithm that minimizes switching regret when a learner plays against an oblivious adversary. The proposed method achieves a switching regret of $\tilde{\mathcal{O}}((1/ρ+ρK)\sqrt{H A T})$, which is efficient in terms of computational complexity, with a per trial time of $\mathcal{O}(H B)$. These results highlight the algorithm's effectiveness in adapting to dynamic strategies in extensive-form games, providing a significant advancement in the understanding of regret minimization in complex decision-making scenarios.
Switching regret can be minimized in extensive-form games with a new algorithm that balances efficiency and performance against dynamic adversarial strategies.
We consider the extensive-form bandit problem where on each trial the learner plays an extensive-form game against an oblivious adversary. We focus on the notion of switching regret, which measures the expected performance of the learner against that of any switching sequence of mixed strategies in retrospect. Our algorithm takes a parameter $ρ>0$ and achieves a switching regret of $\tilde{\mathcal{O}}((1/ρ+ρK)\sqrt{H A T})$ where $K$ is the number of switches in the comparator sequence, $H$ is the maximum number of the learner's information sets that can be traversed during a play of the game and $A$ is the number of actions that the learner can possibly take. Our algorithm is extremely efficient, taking a per trial time of only $\mathcal{O}(H B)$ where $B$ is the maximum number of actions available to the learner at any of its information sets.