Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces PRISMA, an algorithm for simultaneously evaluating $K$ target policies in stochastic linear contextual bandits. PRISMA achieves $\varepsilon$-accuracy for all policies with high probability using $\widetilde{\mathcal{O}}\!\left( \frac{(L^2S^2+\beta^2)(1\vee\rho^\star)}{\varepsilon^2} \cdot \log(K) \right)$ context draws and observations, by leveraging reward-free planning and a shared ridge regression estimator. The method's efficiency stems from a regularized sampling design and an adaptive regularization selection, avoiding dependence on context/action space cardinalities or explicit eigenvalue bounds.
Simultaneously evaluate $K$ policies in linear contextual bandits with near-optimal sample complexity by sharing information across evaluations via a unified ridge regression estimator.
We study how to evaluate $K$ target policies simultaneously in stochastic contextual bandits with linear reward structure. Given a known $d$-dimensional feature map and reward-free access to policy queries, we propose PRISMA (Policy evaluation through Regularized Information Sharing and Mixture Allocation), an algorithm that estimates every target policy's value to accuracy $\varepsilon$ with probability at least $1-\delta$. The algorithm uses $\widetilde{\mathcal{O}}\!\left( \frac{(L^2S^2+\beta^2)(1\vee\rho^\star)}{\varepsilon^2} \cdot \log(K) \right)$ context draws and reward observations, where $\rho^\star\le d$ is an instance-dependent measure of the difficulty of designing a shared sampling distribution. Here, $L$, $S$, and $\beta$ bound the feature norm, reward parameter norm, and reward noise, respectively, and the suppressed factors are logarithmic in $K$, $d$, and $1/\delta$. Our method combines reward-free planning, a regularized sampling design, and a single ridge regression estimator shared across all target policies. An adaptive doubling procedure selects the regularization scale without knowledge of $\rho^\star$. The guarantees require no numerical lower bound on second-moment eigenvalues and have no explicit dependence on the cardinalities of the context and action spaces. Policy-query costs are accounted for separately, with $K$ queries per shared planning context.