Search papers, labs, and topics across Lattice.
This paper introduces SkillChain, an automated framework designed to enhance the performance of image-based AI assistants in e-commerce by evolving Skills through a structured feedback loop. By implementing three key components鈥擲kill Creator, Route Optimizer, and Body Refiner鈥擲killChain effectively addresses the diverse user intents triggered by image uploads, ensuring that the AI's responses are contextually appropriate and high-quality. The deployment of SkillChain led to significant improvements in response quality metrics and user engagement, as demonstrated by a week-long A/B experiment.
SkillChain transforms the way image-based AI assistants adapt to user intents, achieving substantial gains in response quality and user retention.
Image-based AI assistants are now deployed at production scale on e-commerce platforms, where a single uploaded image can trigger fundamentally different user intents: product search, style recommendation, visual encyclopedia, or utility tool calls, each demanding its own response format, tool invocation, and domain knowledge. Without per-intent behavioral constraints, LLM-based systems conflate these heterogeneous modes and fall short of domain quality standards, while the breadth and dynamism of the intent space render manual engineering infeasible. To address this, we present SkillChain, which closes the production feedback loop on Skill evolution, automating the lifecycle of Skills through three stages: Skill Creator for bootstrapping from task specs and trajectories, Route Optimizer for routing alignment, and Body Refiner for iterative Skill Body refinement via dual-path LLM-Judge evaluation. Deployed on a production-scale e-commerce image assistant, SkillChain substantially improves aggregate response quality, with the strongest gains on structural compliance and content quality; a one-week online A/B experiment further confirms significant gains in user engagement, content consumption, and long-term retention.
