Search papers, labs, and topics across Lattice.
This paper introduces Click-to-Ask, an AI assistant for live streaming commerce that combines offline copywriting with online interactive question answering. The offline module extracts structured product data and generates compliant promotional copy from multimodal inputs, while the online module answers viewer questions in real-time using structured data and event-level historical memory. Experiments on a TikTok live stream dataset show a Question Recognition Accuracy of 0.913 and a Response Quality score of 0.876, demonstrating the system's effectiveness.
AI can now handle the tedious copywriting and real-time Q&A for live-streaming commerce, freeing up human streamers to focus on engagement.
Live streaming commerce has become a prominent form of broadcasting in the modern era. To facilitate more efficient and convenient product promotions for streamers, we present Click-to-Ask, an AI-driven assistant for live streaming commerce with complementary offline and online components. The offline module processes diverse multimodal product information, transforming complex inputs into structured product data and generating compliant promotional copywriting. During live broadcasts, the online module enables real-time responses to viewer inquiries by allowing streamers to click on questions and leveraging both the structured product information generated by the offline module and an event-level historical memory maintained in a streaming architecture. This system significantly reduces the time needed for promotional preparation, enhances content engagement, and enables prompt interaction with audience inquiries, ultimately improving the effectiveness of live streaming commerce. On our collected dataset of TikTok live stream frames, the proposed method achieves a Question Recognition Accuracy of 0.913 and a Response Quality score of 0.876, demonstrating considerable potential for practical application. The video demonstration can be viewed here: https://www.youtube.com/shorts/mWIXK-SWhiE.