Search papers, labs, and topics across Lattice.
Cleo is a novel conversational product advisor that enhances transparency and controllability in conversational commerce by integrating a hybrid architecture that separates deterministic ranking from language generation. The system employs a ranker that utilizes categorical filters and numeric loss functions on 3,638 product specifications, while a constrained LLM generates grounded descriptions to minimize hallucinations. This innovative approach not only facilitates natural-language comparisons but also provides auditable insights into ranking decisions, significantly improving user decision-making in online product searches.
Cleo transforms conversational commerce by combining transparent ranking with controllable language generation, enabling users to make informed decisions without the pitfalls of LLM unpredictability.
We demonstrate Cleo, a transparent and controllable conversational product advisor that addresses the challenges of opacity, unpredictability of LLMs, and the complexity of comparisons in conversational commerce. With our chatbot system, we make four contributions: First, we introduce transparency by prompting the LLM to reflect on interpreted user needs, while an auditable ranking mechanism reveals loss values per attribute, explaining ranking decisions. Second, we propose controllability through a hybrid architecture separating deterministic ranking from language generation. A ranker applies categorical filters and numeric loss functions over 3,638 product specifications. Meanwhile, a constrained LLM generates grounded descriptions constrained to catalog evidence, thus mitigating the risk of hallucinated or persuasive content. Third, we provide decision support in the form of natural-language comparisons and a highlights feature. These aim to reduce mental workload by contextualizing specifications relative to user needs. Fourth, we contribute an extensible experimental system for IR and HCI researchers, as well as practitioners of conversational search and recommendation. Unlike traditional faceted search or opaque LLM-only recommenders, our approach allows for fluid conversation while maintaining algorithmic transparency. In a live demonstration, attendees will experience information needs elicitation and reflection, conversational refinement with real-time re-ranking, inspection of per-attribute loss explanations, and AI-generated multi-item comparisons. The system aims to advance the design of transparent and controllable conversational systems that provide support for decision-making during online product search.
