Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper investigates overgeneration phenomena in LLM-based machine translation, distinguishing them from neurobabble in NMT systems. It categorizes these overgenerations into self-explanations, confabulations, and human-like explanations that enhance comprehension. The study presents detection strategies and results from a commercial application, highlighting the challenges of identifying the nature of these overgenerations.
LLMs don't just translate, they hallucinate explanations, confabulate risks, and sometimes, even translate like humans – understanding when they do which is the real challenge.
LLMs are proving to be adept at machine translation although due to their generative nature they may at times overgenerate in various ways. These overgenerations are different from the neurobabble seen in NMT and range from LLM self-explanations, to risky confabulations, to appropriate explanations, where the LLM is able to act as a human translator would, enabling greater comprehension for the target audience. Detecting and determining the exact nature of the overgenerations is a challenging task. We detail different strategies we have explored for our work in a commercial setting, and present our results.