Search papers, labs, and topics across Lattice.
This paper introduces the Distortion Graph (DG), a novel representation for comparative image assessment that structures paired images as region-based graphs encoding distortion type, severity, and quality scores. They contribute PandaSet, a region-level dataset, PandaBench, a benchmark suite, and Panda, an architecture to generate DGs. Experiments show that MLLMs struggle with region-level degradations in PandaBench, but can be improved by training on PandaSet or prompting with DGs.
Current MLLMs can't see the forest for the trees when it comes to image quality assessment, failing to understand region-level degradations even with explicit cues.
In this work, we introduce a new perspective on comparative image assessment by representing an image pair as a structured composition of its regions. In contrast, existing methods focus on whole image analysis, while implicitly relying on region-level understanding. We extend the intra-image notion of a scene graph to inter-image, and propose a novel task of Distortion Graph (DG). DG treats paired images as a structured topology grounded in regions, and represents dense degradation information such as distortion type, severity, comparison and quality score in a compact interpretable graph structure. To realize the task of learning a distortion graph, we contribute (i) a region-level dataset, PandaSet, (ii) a benchmark suite, PandaBench, with varying region-level difficulty, and (iii) an efficient architecture, Panda, to generate distortion graphs. We demonstrate that PandaBench poses a significant challenge for state-of-the-art multimodal large language models (MLLMs) as they fail to understand region-level degradations even when fed with explicit region cues. We show that training on PandaSet or prompting with DG elicits region-wise distortion understanding, opening a new direction for fine-grained, structured pairwise image assessment.
