Search papers, labs, and topics across Lattice.
This paper explores offline policy learning for distributional outcomes, focusing on how to optimize treatment rules that maximize empirical welfare using Wasserstein barycenters of outcome distributions. By leveraging Inverse Probability Weighting and Doubly Robust estimators, the authors establish statistical guarantees and derive a finite-sample regret bound that reflects the complexity of the policy class. The results highlight that even in one-dimensional Wasserstein settings, the regret rate is fundamentally tied to the complexity of the policy class, with a minimax lower bound confirming the sharpness of their findings.
Learning policies for distributional outcomes reveals that regret rates are intricately linked to policy class complexity, challenging conventional wisdom in offline policy learning.
Offline policy learning has received growing attention in causal inference. The primary objective is to learn a policy (individualized treatment rule) as a mapping from covariates to treatment that maximizes the empirical welfare defined as the mean of scalar-valued potential outcomes. In this paper, we study offline policy learning with distribution-valued outcomes, where each potential outcome is a probability measure on $\mathbb{R}$ and the reward is defined through a utility functional applied to the Wasserstein barycenter of induced outcome distributions. We establish statistical guarantees for the policy learning framework based on both Inverse Probability Weighting (IPW) and Doubly Robust (DR) estimators. By handling the challenging uniform deviation over the product of the combinatorial policy class and the infinite-dimensional quantile domain, we prove that the finite-sample regret has leading dependence $\widetilde{\mathcal{O}}(\sqrt{\mathrm{N\text{-}dim}(螤)/N})$. In the one-dimensional Wasserstein setting and under the stated regularity conditions, the leading regret rate is still governed by the policy-class complexity. Moreover, we provide a minimax lower bound establishing the sharpness of the leading dependence on $N$ and $\mathrm{N\text{-}dim}(螤)$.
