Search papers, labs, and topics across Lattice.
The paper introduces DocQAC, a novel task of in-document query auto-completion, and proposes an adaptive trie-guided decoding framework to improve the quality of query suggestions. This framework softly steers language models toward high-quality completions using user query prefixes and an adaptive penalty mechanism to balance model confidence and trie-based guidance. Experiments on a new DocQAC benchmark derived from ORCAS show that the proposed method outperforms strong baselines and even larger instruction-tuned models on seen queries in both seen and unseen documents.
Surprisingly, a trie-guided decoding framework applied to smaller encoder-decoder models like T5 and BART can outperform much larger instruction-tuned models like LLaMA-3 and Phi-3 in in-document query auto-completion.
Query auto-completion (QAC) has been widely studied in the context of web search, yet remains underexplored for in-document search, which we term DocQAC. DocQAC aims to enhance search productivity within long documents by helping users craft faster, more precise queries, even for complex or hard-to-spell terms. While global historical queries are available to both WebQAC and DocQAC, DocQAC uniquely accesses document-specific context, including the current document's content and its specific history of user query interactions. To address this setting, we propose a novel adaptive trie-guided decoding framework that uses user query prefixes to softly steer language models toward high-quality completions. Our approach introduces an adaptive penalty mechanism with tunable hyperparameters, enabling a principled trade-off between model confidence and trie-based guidance. To efficiently incorporate document context, we explore retrieval-augmented generation (RAG) and lightweight contextual document signals such as titles, keyphrases, and summaries. When applied to encoder-decoder models like T5 and BART, our trie-guided framework outperforms strong baselines and even surpasses much larger instruction-tuned models such as LLaMA-3 and Phi-3 on seen queries across both seen and unseen documents. This demonstrates its practicality for real-world DocQAC deployments, where efficiency and scalability are critical. We evaluate our method on a newly introduced DocQAC benchmark derived from ORCAS, enriched with query-document pairs. We make both the DocQAC dataset (https://bit.ly/3IGEkbH) and code (https://github.com/rahcode7/DocQAC) publicly available.
Microsoft Research