Search papers, labs, and topics across Lattice.
This paper investigates the limitations of adaptive algorithms in fixed-budget best-arm identification, where the goal is to identify the arm with the highest mean from a set of options under a sampling budget. The authors prove that no adaptive algorithm can uniformly match the error decay rate of the static oracle across all instances, specifically demonstrating that the error decay rate for any algorithm is at least a logarithmic factor worse than that of the static oracle for any number of arms \( K \ge 3 \). This finding resolves an open question in the field and highlights fundamental constraints in the performance of adaptive sampling strategies.
No adaptive algorithm can achieve the same error decay rate as a static oracle in fixed-budget best-arm identification, revealing a critical limitation in adaptive sampling strategies.
In fixed-budget best-arm identification, also known as ranking and selection, an algorithm has a sampling budget to distribute across $K$ arms. Each sample provides noisy feedback about that arm's mean, and the goal is to identify the arm with the largest mean. A common performance benchmark is the static oracle: a non-adaptive strategy that knows the means in advance and chooses fixed sampling proportions to maximize the exponential decay rate of the probability of incorrect identification. Several adaptive algorithms have been constructed such that their sampling proportions converge to the static oracle proportions. However, it has remained open whether any algorithm could match the static oracle's error decay rate uniformly across all problem instances. We answer this in the negative. For any $K\ge 3$ and for rewards drawn from any one-parameter natural exponential family, we show that for any algorithm, there is at least one instance where the error decay rate is at most $\left(1 + \frac{\log(K)}{8}\right)^{-1}$ times that of the static oracle. This also answers the open question posed by Qin (2022), showing that fixed-budget best-arm identification does not admit a complexity.