Search papers, labs, and topics across Lattice.
This study explores the representation of ill-posed questions in large language models (LLMs) through a unified topology of internal states, employing finite zero-dimensional persistent homology to analyze the geometry of contextual hidden states across transformer layers. By summarizing each layer with descriptors such as mean finite lifetime and normalized lifetime entropy, the authors develop a topology representation that enhances ill-posedness classification and enables topology-conditioned activation steering for improved response behavior. The results demonstrate a significant increase in classification accuracy and acceptable response rates, highlighting the effectiveness of persistent homology in addressing the challenges posed by ambiguous queries in LLMs.
Persistent homology reveals a structured approach to understanding and steering LLM responses to ambiguous questions, boosting accuracy and acceptable response rates significantly.
Ill-posed questions, including ambiguous, underspecified, or contradictory queries, may admit no valid answer or multiple plausible answers, posing a challenge for large language models (LLMs). Existing approaches largely analyze ill-posedness through model outputs and often focus on specific subclasses. We investigate whether diverse sources of ill-posedness can be represented within a unified topology of LLM internal states and whether this structure can be used to steer response behavior. We model the contextual hidden states of prompt tokens at each transformer layer as a point cloud and characterize its geometry using finite zero-dimensional persistent homology. Each layer is summarized by three compact descriptors: mean finite lifetime, normalized lifetime entropy, and largest-lifetime concentration. Concatenating these descriptors across layers yields a topology representation of the question. We further introduce topology-conditioned activation steering, which retrieves topologically similar examples and constructs query-specific activation interventions that encourage source-aware clarification or abstention. Across three open-weight LLMs, topology features consistently outperform prompt-based and pooled-hidden-state baselines for ill-posedness classification, improving average accuracy from \(67.4\%\) to \(78.9\%\) on AmbigQA, from \(79.9\%\) to \(88.5\%\) on SituatedQA, and from \(57.6\%\) to \(69.6\%\) on CLAMBER 9-way classification. Topology-conditioned steering increases the average total acceptable response rate from \(61.4\%\) to \(70.6\%\) and grounded acceptable responses from \(11.9\%\) to \(16.4\%\). These results show that persistent homology provides both an interpretable representation of ill-posedness and an effective mechanism for targeted response steering.
