Search papers, labs, and topics across Lattice.
LocalSUG, an LLM-based query suggestion framework, tackles the challenges of geographic grounding, exposure bias, and online latency in local-life service platforms. It incorporates a city-aware candidate mining strategy for geographic grounding and a beam-search-driven GRPO algorithm with a multi-objective reward to mitigate exposure bias. Furthermore, quality-aware beam acceleration and vocabulary pruning techniques are introduced to reduce online latency. Online A/B testing demonstrates a +0.35% CTR improvement and a 2.56% reduction in low/no-result rate.
LLMs can power better local search, but only if you ground them geographically, align training with inference, and aggressively prune the vocabulary for speed.
In local-life service platforms, the query suggestion module plays a crucial role in enhancing user experience by generating candidate queries based on user input prefixes, thus reducing user effort and accelerating search. Traditional multi-stage cascading systems rely heavily on historical top queries, limiting their ability to address long-tail demand. While LLMs offer strong semantic generalization, deploying them in local-life services introduces three key challenges: lack of geographic grounding, exposure bias in preference optimization, and online inference latency. To address these issues, we propose LocalSUG, an LLM-based query suggestion framework tailored for local-life service platforms. First, we introduce a city-aware candidate mining strategy based on term co-occurrence to inject geographic grounding into generation. Second, we propose a beam-search-driven GRPO algorithm that aligns training with inference-time decoding, reducing exposure bias in autoregressive generation. A multi-objective reward mechanism further optimizes both relevance and business-oriented metrics. Finally, we develop quality-aware beam acceleration and vocabulary pruning techniques that significantly reduce online latency while preserving generation quality. Extensive offline evaluations and large-scale online A/B testing demonstrate that LocalSUG improves click-through rate (CTR) by +0.35% and reduces the low/no-result rate by 2.56%, validating its effectiveness in real-world deployment.
