Search papers, labs, and topics across Lattice.
This paper investigates failure modes in LLMs for entity-based factual queries, distinguishing between hallucination (knowledge exists but is expressed incorrectly) and deception (knowledge is intentionally misrepresented). They create a controlled environment where knowledge existence is preserved while behavioral expression is altered, enabling analysis of four behavioral cases. Through representation separability, sparse interpretability, and inference-time activation steering, they analyze the distinct mechanisms underlying hallucination and deception.
LLM factual errors aren't just about missing knowledge; sometimes the model *knows* the truth but deliberately says otherwise.
Failures in large language models (LLMs) are often analyzed from a behavioral perspective, where incorrect outputs in factual question answering are commonly associated with missing knowledge. In this work, focusing on entity-based factual queries, we suggest that such a view may conflate different failure mechanisms, and propose an internal, mechanism-oriented perspective that separates Knowledge Existence from Behavior Expression. Under this formulation, hallucination and deception correspond to two qualitatively different failure modes that may appear similar at the output level but differ in their underlying mechanisms. To study this distinction, we construct a controlled environment for entity-centric factual questions in which knowledge is preserved while behavioral expression is selectively altered, enabling systematic analysis of four behavioral cases. We analyze these failure modes through representation separability, sparse interpretability, and inference-time activation steering.
