Search papers, labs, and topics across Lattice.
This paper explores the application of optimal transport (OT) for detecting hallucinations in neural machine translation (NMT) and abstractive summarization, analyzing the cross-attention distributions across all six decoder layers of the Fairseq DE-EN model. The findings reveal that layers L1 to L4 are effective in detecting hallucinations, while layer L5 exhibits anti-predictive behavior, and that hallucinated translations lack the exploratory attention phase seen in correct translations. Additionally, the unsupervised OT detector shows promise for summarization tasks, achieving balanced accuracy above chance, but highlights a fundamental limitation in detecting faithfulness failures due to the nature of attention mechanisms.
Layer-resolved analysis reveals that optimal transport can effectively detect hallucinations in NMT, but struggles with faithfulness in summarization, exposing a critical gap in current evaluation methods.
Optimal transport (OT) has been shown to detect hallucinations in neural machine translation (NMT) by measuring the geometric distance between cross-attention distributions and a reference distribution, without any supervision. We extend this analysis to all six decoder layers of the Fairseq DE-EN model ($N=3{,}414$), showing that Wass-to-Unif and Wass-to-Data are complementary detectors specialised across hallucination types, that detection is concentrated in layers L1--L4 with L5 anti-predictive for subtler types, and that hallucinated translations lack the exploratory attention phase present in correct translations from the first decoding step. We further evaluate whether the geometric signal transfers to abstractive summarization faithfulness detection: our unsupervised OT detector on AggreFact ($N=1{,}116$) achieves $57.2\%$/$57.6\%$ balanced accuracy on CNN/XSum -- above chance but substantially below supervised MiniCheck-Flan-T5-L($69.9\%$/$74.3\%$). This gap is principled: unlike NMT hallucinations, unfaithful summaries can attend correctly to source tokens while misrepresenting their content, a failure mode invisible to concentration-based OT metrics by construction. Structural experiments on T5-base confirm consistent decoder organisation across depth, with Layer~3 showing peak concentration and Layer~12 being most critical for generation quality. Together, the results establish OT on cross-attention as a reliable detector when the failure mode is source disengagement, a principled interpretability tool regardless of task, and fundamentally limited when faithfulness failures occur downstream of attention.
