Search papers, labs, and topics across Lattice.
This paper investigates the phenomenon of message-free hallucination in Automatic Speech Recognition (ASR) and Neural Machine Translation (NMT) by analyzing the behavior of reserved null tokens in encoder-decoder systems. The authors find that while null-token scores can indicate an abstention signal, standard decoding methods fail to leverage this information effectively, leading to both hallucinations and the risk of losing valid outputs. By adjusting null-token scores, they demonstrate a significant reduction in fabrication, though caution is required to avoid excessive deletion of legitimate content, highlighting the need for a nuanced evaluation of abstention methods.
Null tokens can serve as a powerful diagnostic tool for hallucination in ASR and NMT, revealing a trade-off between suppressing fabrication and maintaining valid outputs.
Modern encoder-decoder systems can produce fluent text even when their input contains no recoverable message. We study this failure in ASR and NMT through the models' reserved null tokens, asking whether the score for ending generation already carries a usable abstention signal. Across speech recognizers and translation models, we audit native null-token scores and scalar logit shifts. In Whisper, we additionally probe decoder states and compare supervised row edits with conventional external gates. The evaluated models often expose a useful abstention signal, but stock decoding does not reliably act on it. Raising the null-token score can sharply suppress fabrication, but aggressive intervention also deletes valid speech or shortens legitimate translations. These findings turn the null token into a diagnostic lens on hallucination and motivate evaluating abstention methods by both suppression and deletion costs, rather than by hallucination reduction alone.
