Search papers, labs, and topics across Lattice.
This paper introduces one-step and two-step methods for policy learning using retrieval-augmented generation (RAG) within a causal inference framework. By employing vector search for action-specific evidence retrieval, the two-step method connects nearest-neighbor matching to action selection, allowing for the estimation of conditional expected outcomes. The authors provide a regret decomposition for the two-step method, demonstrating bounds on choice regret through prediction-error guarantees, and evaluate the one-step method as a direct policy without intermediate observations.
RAG-based policy learning can significantly enhance causal inference by effectively integrating nearest-neighbor matching for action selection.
We propose one-step and two-step methods for policy learning with retrieval-augmented generation (RAG). We formulate RAG-based action selection under the potential outcome framework. In the two-step method, vector search retrieves action-specific neighboring evidence in an embedding space, the generator estimates conditional expected outcomes or their contrasts, and a plug-in rule selects an action. This formulation connects action-specific vector search with nearest-neighbor matching in causal inference. We decompose the regret of the two-step method into candidate-generation regret and within-candidate choice regret, and we bound the latter using prediction-error guarantees for nearest-neighbor estimators and transformers. We evaluate the one-step method directly as a policy because its intermediate computation is unobserved.
