Search papers, labs, and topics across Lattice.
This paper introduces ActiveScope, a training-free framework designed to enhance the perception capabilities of Multimodal Large Language Models (MLLMs) in high-resolution image understanding. The authors identify two key issues鈥擟ontextual Dominance and Semantic Bias鈥攖hat hinder accurate localization of multiple targets in images, and propose a solution that incorporates Semantic Anchor Localization and Interference-Suppressed Refinement to address these challenges. Experimental results show that ActiveScope significantly outperforms existing methods, achieving 96.34% accuracy on the $V^{*}$ Bench, highlighting its effectiveness in improving fine-grained perception.
ActiveScope achieves a remarkable 96.34% accuracy in high-resolution image understanding by actively correcting perception flaws in MLLMs.
Multimodal Large Language Models (MLLMs) have demonstrated impressive vision-language understanding, yet still struggle with fine-grained perception in high-resolution images. While existing training-free methods typically rely on attention-based localization or coarse-to-fine search, they are often misled by distractors and fail to locate multiple targets. Our investigation attributes these failures to Contextual Dominance, where salient distractors overwhelm target attention and cause inaccurate localization, and Semantic Bias, where global semantics cause the model to fixate on the most salient concept, resulting in incomplete localization in multi-object scenarios. Built on these insights, we propose ActiveScope, a training-free framework that enhances MLLMs by actively seeking and correcting perception. ActiveScope features two modules. The Semantic Anchor Localization (SAL) utilizes fine-grained semantic anchors to independently localize key targets, thereby mitigating semantic bias. The Interference-Suppressed Refinement (ISR) refines localization by suppressing attention on salient distractions to overcome contextual dominance. Extensive experiments on high-resolution image understanding benchmarks demonstrate that ActiveScope outperforms existing training-free methods (e.g., 96.34 percent accuracy on $V^{*}$ Bench), validating the superiority of the active search and self-correction paradigm. Our code is available at https://github.com/jasmine-ww/ActiveScope.
