Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Kernel-WIS, a new estimator for off-policy evaluation in contextual bandits that leverages offline data. By combining the bounded property of vanilla weighted importance sampling with the linearity of traditional importance sampling, Kernel-WIS achieves asymptotic consistency and outperforms existing methods, particularly in scenarios with behavior policy miss-specification. The empirical results demonstrate significant improvements over strong baselines, highlighting the estimator's robustness in complex evaluation settings.
Kernel-WIS outperforms traditional methods in off-policy evaluation, even when the behavior policy is mis-specified.
This article presents a novel estimator for performing off-policy evaluation using only offline data for contextual bandits. The proposed estimator, Kernel-WIS is demonstrated to be asymptotically consistent and to empirically outperform strong baselines (including vanilla weighted importance sampling), particularly under complex conditions including behaviour policy miss-specification. The benefit of Kernel-WIS is derived from combining the bounded property of vanilla weighted importance sampling with the linearity of vanilla importance sampling.