Search papers, labs, and topics across Lattice.
This paper introduces WARP, a novel family of post-retrieval algorithms designed to enhance the representation of population opinions in RAG systems by calibrating retrieved evidence to match the target opinion distribution. By leveraging Wasserstein-1 distance, WARP effectively recovers underrepresented views and ensures that the sentiment-intensity distribution of selected documents aligns with the population's consensus, addressing limitations of existing diversity re-rankers and calibration methods. Experimental results across diverse domains show that WARP reduces distributional error by at least 43% while maintaining sub-second latency, significantly improving the quality of generated summaries as preferred by human judges.
WARP reduces distributional error by over 43% while ensuring underrepresented opinions are included, revolutionizing how RAG systems summarize public sentiment.
RAG systems are increasingly used to summarize what large collections of documents say. A user asks"What do people think about X?"and receives an answer that reads as consensus. But standard top-k retrieval ranks documents by query similarity, not by how faithfully they represent the population, so minority views quietly disappear. Existing fixes fall short. Diversity re-rankers like MMR and DPP spread retrieved documents apart, but with no target distribution to aim for. Calibration methods based on KL or JS divergence do target one, yet treat opinion bins as unordered: confusing strong positive with strong negative costs no more than an adjacent-bin miss. We introduce WARP, a family of post-retrieval algorithms that calibrate retrieved evidence to the population's opinion distribution. WARP first recovers underrepresented opinions that cosine ranking may bury, then uses Wasserstein-1 distance to select documents whose sentiment-intensity distribution matches the population target, capturing the ordinal structure ignored by KL and JS divergence. We develop three variants for dense, sparse, and variable candidate pools, trading off calibration quality and speed. Across three review domains spanning 35K documents, 156 queries, and 26 entities, WARP's domain-matched variants reduce distributional error by at least 43% with sub-second latency. These gains carry through to generation: a five-judge LLM panel prefers WARP-generated answers in 86% of decided comparisons at k<= 5.
