Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces LAG-XAI, a geometric framework that models paraphrasing as affine transformations within Transformer embedding spaces, enabling interpretable analysis of semantic changes. By approximating paraphrase transitions as a continuous geometric flow using a mean-field approach inspired by Lie groups, the method decomposes these transitions into rotation, deformation, and translation components. Experiments on paraphrase datasets and LLM hallucination detection demonstrate the framework's ability to capture semantic relationships and detect factual distortions with high accuracy while offering explicit parametric interpretability.
Forget discrete word substitutions – paraphrasing can be understood as a continuous geometric flow with interpretable rotation, deformation, and translation components within Transformer latent spaces.
Modern Transformer-based language models achieve strong performance in natural language processing tasks, yet their latent semantic spaces remain largely uninterpretable black boxes. This paper introduces LAG-XAI (Lie Affine Geometry for Explainable AI), a novel geometric framework that models paraphrasing not as discrete word substitutions, but as a structured affine transformation within the embedding space. By conceptualizing paraphrasing as a continuous geometric flow on a semantic manifold, we propose a computationally efficient mean-field approximation, inspired by local Lie group actions. This allows us to decompose paraphrase transitions into geometrically interpretable components: rotation, deformation, and translation. Experiments on the noisy PIT-2015 Twitter corpus, encoded with Sentence-BERT, reveal a "linear transparency" phenomenon. The proposed affine operator achieves an AUC of 0.7713. By normalizing against random chance (AUC 0.5), the model captures approximately 80% of the non-linear baseline's effective classification capacity (AUC 0.8405), offering explicit parametric interpretability in exchange for a marginal drop in absolute accuracy. The model identifies fundamental geometric invariants, including a stable matrix reconfiguration angle (~27.84°) and near-zero deformation, indicating local isometry. Cross-domain generalization is confirmed via direct cross-corpus validation on an independent TURL dataset. Furthermore, the practical utility of LAG-XAI is demonstrated in LLM hallucination detection: using a "cheap geometric check," the model automatically detected 95.3% of factual distortions on the HaluEval dataset by registering deviations beyond the permissible semantic corridor. This approach provides a mathematically grounded, resource-efficient path toward the mechanistic interpretability of Transformers.