Saugata Purkayastha

Machine translation benchmarks have functionally saturated, but pairing human-authored failure cases with deterministic verification rules reveals critical multimodal blind spots that automated metrics consistently miss.

LLMs often choose moral consistency over basic common sense, especially when the contradiction is committed by the main character in a narrative.