Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces CORAL, an LLM-native harness that automates the continual optimization of production recommender systems by closing the feedback loop between real-time performance signals and decision-making. By formulating the problem as a partially observed, non-stationary, constrained optimization task, CORAL enables an agent to learn from past actions without requiring parameter updates. The results from A/B experiments on two large-scale social platforms demonstrate that CORAL can enhance user engagement without increasing serving costs or reduce costs while maintaining engagement levels, showcasing its effectiveness in optimizing recommender systems dynamically.
CORAL automates the continual optimization of recommender systems, achieving improved user engagement and reduced costs without human intervention.
Production recommender systems shape what billions of people see, and sustaining their performance requires continual optimization: as content, user behavior, and upstream models shift, the choices governing retrieval, ranking, and serving must be revisited. Traditionally, human engineers test such changes through online experiments--a slow, reactive process limited by engineering effort, leaving parts of the system unrevised as conditions change. Although large language models have been applied to ranking, user modeling, and offline model development, few systems place an agent in a continual closed loop that acts on a live recommender and learns from the measured effects of its decisions. We present CORAL (Constraint-Optimized Recommender via an Agentic Loop), an LLM-native harness that closes this loop: each cycle, the agent observes operating signals, reasons over a memory of past decisions and outcomes, and invokes tools--including a numerical optimizer that keeps changes within a fixed operating budget--to reconfigure the recommender, with measured outcomes informing the next cycle. We formulate this as a partially observed, non-stationary, constrained optimization problem in which the policy improves in context, without parameter updates, from its prior actions. Across two large-scale social platforms, evaluated with A/B experiments, the same harness improves engagement at no additional serving cost on one and reduces serving cost without degrading engagement on the other, spanning the engagement-efficiency frontier. Performance improves as the loop iterates, suggesting that a single agentic loop can automate continual optimization work traditionally performed by human algorithm engineers under explicit guardrails.