Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper addresses the gap between high offline accuracy and poor production performance in sales lead ranking systems by introducing SalesLoop, a reinforcement learning framework that creates a feedback loop between model predictions and actual business outcomes. The framework incorporates a performance-aware reward system and a novel listwise optimization objective, Discriminative GRPO, which together enhance lead ranking effectiveness. Experimental results show significant improvements in key metrics, with a 4.7% lift in cumulative sales outcomes during a 160-day A/B test involving over 16 million leads.
SalesLoop boosts sales lead conversion rates by 2.3 times compared to traditional methods, bridging the gap between offline model performance and real-world results.
Lead ranking in Customer Relationship Management (CRM) systems faces a persistent challenge: models achieving high offline accuracy often underperform in production. We identify three fundamental gaps responsible for this disconnect: offline-online metric mismatch, pointwise-listwise objective misalignment, and temporal distribution drift. To address these gaps, we propose SalesLoop, a reinforcement learning framework that establishes a closed feedback loop between model predictions and real-world business outcomes. Our approach introduces (1) a performance-aware reward that encodes conversion outcomes weighted by ranking position and conversion velocity, and (2) Discriminative GRPO, a listwise optimization objective that adapts Group Relative Policy Optimization to discriminative ranking models. SalesLoop improves NDCG@K by +7.9\% and P@K by +15.8\% over the strongest static baseline. A 160-day production A/B test at a New Energy Vehicle manufacturer, spanning 16.5M leads and 280 sales specialists across two provincial markets, validates statistically significant cumulative lift of +4.7\% ($p=0.047$) and +8.7\% ($p=0.002$). In production, the ranking backbone achieves Top-10\% recall of 44.1\% and surfaces high-intent leads at $2.3\times$ the conversion rate of specialist baselines.