Search papers, labs, and topics across Lattice.
The paper introduces RSHBench, a new benchmark for diagnosing factual and logical hallucinations in Multimodal Large Language Models (MLLMs) applied to remote sensing visual question answering (RS-VQA). It identifies visual grounding failures and misinterpretation of fine-grained targets as primary causes of these hallucinations. To address this, the authors propose Relative Attention-Driven Actively Reasoning (RADAR), a training-free inference method that uses the MLLM's intrinsic attention to guide localization and reasoning.
You can cut MLLM hallucinations in remote sensing tasks without any training by cleverly exploiting the model's own attention mechanisms to focus on relevant image regions.
Multimodal large language models (MLLMs) suffer from pronounced hallucinations in remote sensing visual question-answering (RS-VQA), primarily caused by visual grounding failures in large-scale scenes or misinterpretation of fine-grained small targets. To systematically analyze these issues, we introduce RSHBench, a protocol-based benchmark for fine-grained diagnosis of factual and logical hallucinations. To mitigate grounding-induced factual hallucinations, we further propose Relative Attention-Driven Actively Reasoning (RADAR), a training-free inference method that leverages intrinsic attention in MLLMs to guide progressive localization and fine-grained local reasoning at test time. Extensive experiments across diverse MLLMs demonstrate that RADAR consistently improves RS-VQA performance and reduces both factual and logical hallucinations. Code and data will be publicly available at: https://github.com/MiliLab/RADAR
