Search papers, labs, and topics across Lattice.
To prevent multimodal LLMs from relying on spurious language priors for forensic explanations, this work establishes a training-free framework that transforms explainable deepfake detection into a sequential local-to-global evidence acquisition pipeline. The approach identifies subtle manipulation regions by contrasting decoder cross-attention between clean and Gaussian-blurred images, subsequently inspecting localized crops before aggregating them with global context. Across five open-source MLLMs on the TriDF and MMTD-Set benchmarks, the method improves detection accuracy by up to 12.8% while cutting CHAIR metric hallucination rates by up to 33.4%.
Contradicting the assumption that MLLMs require specialized forensic fine-tuning to spot subtle image edits, simply contrasting cross-attention against a Gaussian-blurred baseline isolates genuine manipulation artifacts and cuts explanatory hallucination by up to 33.4% training-free.
Multimodal large language models (MLLMs) can explain deepfake verdicts in natural language, but such explanations are not necessarily visually grounded in the visual evidence underlying the prediction. A model may describe plausible artifacts inferred from language priors rather than from image evidence. Existing grounding methods improve visual reliance through decoding or attention interventions, but they generally strengthen grounding over the entire image, making them ill-suited for forensic artifacts that are subtle, spatially localized, and image-dependent. We propose Look Before You Judge, a training-free framework that formulates explainable deepfake detection as a sequential evidence acquisition process. Instead of directly predicting image authenticity from holistic visual reasoning, our framework first identifies image-specific candidate evidence regions by contrasting the MLLM's decoder-to-visual attention between an original image and its Gaussian-blurred counterpart. The identified regions are then inspected individually, and the resulting local evidence is integrated with the global image context before reaching a final verdict. The framework operates without manipulation masks, external forensic models, or parameter updates, making it directly applicable to off-the-shelf MLLMs. Across five open-source MLLMs on TriDF and MMTD-Set, our framework improves detection accuracy by up to 12.8%, reduces CHAIR by up to 33.4% and hallucination rate by up to 21.3%, and outperforms representative training-free decoding and attention methods.