Search papers, labs, and topics across Lattice.
To transition image quality assessment from holistic black-box scoring to interpretable degradation diagnosis, the authors develop GS-IQA, an MLLM framework that operationalizes a progressive "Where鈥揥hat鈥揌ow" perceptual reasoning process. The architecture uses a two-stage reinforcement learning paradigm featuring perception-gated rewards鈥攚hich strictly condition severity feedback on correct spatial localization and distortion classification鈥攃oupled with online reward-conditioned degradation generation to target model bottlenecks. Evaluated on the newly introduced 25K-sample Diag-Bench, the method outperforms state-of-the-art multimodal models on fine-grained degradation reasoning while simultaneously improving downstream zero-shot transfer on conventional global IQA benchmarks.
Severity scores are meaningless without spatial grounding: gating RL rewards on strictly ordered localization and classification dependencies forces MLLMs to diagnose visual degradation rather than hallucinate holistic quality metrics.
Multi-modal large language models (MLLMs) have demonstrated significant potential in image quality assessment (IQA) by bridging visual perception with descriptive evaluations. However, existing approaches mainly focus on holistic quality prediction, often functioning as black boxes that provide limited insight into where distortions occur and how they affect perceived quality, hindering fine-grained analysis of localized and heterogeneous degradations. We propose GS-IQA, a framework that reformulates IQA as a progressive Where--What--How diagnosis, emulating the human perceptual process from an initial glance to closer scrutiny. Since a severity judgment is meaningful only for a correctly localized and recognized region, we realize this progression through a two-stage reinforcement learning paradigm that respects such dependencies: the glance stage uses a perception-gated reward to establish where degradations lie and what they are, activating severity feedback only once both are correct, while the scrutiny stage introduces online reward-conditioned degradation generation to synthesize hard examples targeted at the model's perceptual bottlenecks, sharpening its discrimination of subtle severity variations. To enable systematic evaluation, we construct Diag-Bench, a region-level IQA benchmark of about 25K curated samples spanning 12 distortion types and five ordinal severity levels. Extensive experiments show that GS-IQA consistently surpasses state-of-the-art methods in distortion localization, recognition, and severity estimation, and that its diagnostic representations transfer effectively to conventional global quality prediction across diverse external benchmarks. Code and data will be released.
