Search papers, labs, and topics across Lattice.
This paper introduces an uncertainty-aware framework for adaptive question answering (QA) that leverages internal representations of large language models (LLMs) to enhance transparency and reduce hallucinations. By differentiating between knowledge insufficiency and knowledge ambiguity, the framework efficiently estimates these conditions in a single forward pass, guiding when to trigger retrieval-augmented generation (RAG) or apply additional reasoning. The key result shows that this method not only improves factual accuracy but also provides a clearer rationale for the system's decisions, making it more interpretable for users.
By grounding adaptive retrieval in interpretable uncertainty signals, this framework transforms how LLMs handle knowledge gaps and ambiguities in real-time.
Large language models (LLMs) achieve a strong performance in question answering (QA), but remain prone to hallucinations and suffer from limited transparency. Retrieval-augmented generation (RAG) can improve factuality, yet decisions about when and how to retrieve from external resources are typically based on opaque policies or computationally inefficient multi-step prompting procedures. We propose an uncertainty-aware framework for adaptive QA based on explicit signals derived from LLM internal representations. We distinguish between knowledge insufficiency and knowledge ambiguity or conflict, and efficiently estimate these from hidden states in a single forward pass. These signals guide system behaviour: RAG is triggered when knowledge is insufficient, while additional reasoning is applied when ambiguity or conflict is high. By grounding adaptive decisions in decomposed and efficiently estimable uncertainty signals, this approach provides a transparent and practical alternative to existing retrieval and reasoning strategies supporting the design of interpretable user-facing tools.
