Search papers, labs, and topics across Lattice.
This paper addresses the limitations of existing vision-language models in AI-generated image quality assessment by introducing MST-CLIPIQA, a multi-scale two-stream framework that decouples semantic understanding from perceptual distortions. The architecture employs dual CLIP encoders to capture both global semantic coherence and fine-grained textural details, utilizing a gated fusion mechanism for adaptive cross-scale distillation. Experimental results demonstrate significant improvements over previous methods, achieving state-of-the-art performance across five benchmarks with minimal additional parameters.
Fine-grained quality degradations can now be assessed without sacrificing semantic coherence, thanks to a novel two-stream architecture that redefines vision-language alignment.
Existing vision-language model (VLM)-based AI-generated image quality assessment (AIGIQA) methods suffer from a fundamental semantic-distortion dimensional conflict: monolithic representations optimized for semantic discrimination inherently entangle compositional understanding with low-level perceptual sensitivity, rendering them blind to fine-grained quality degradations. We introduce MST-CLIPIQA, a multi-scale two-stream framework that achieves hierarchical vision-language alignment through explicit representational decoupling. Our architecture leverages dual CLIP encoders with complementary patch granularities: coarse-grained streams capture global semantic coherence while fine-grained streams preserve textural signatures and artifact patterns. An information bottleneck-inspired gated fusion mechanism performs adaptive cross-scale distillation, with optional cross-attention enabling prompt-anchored correspondence evaluation when generation prompts are available. Extensive experiments across five benchmarks establish new state-of-the-art results, achieving average improvements of 1.11 percent SRCC on quality and 2.35 percent SRCC on text-image correspondence prediction, while maintaining efficiency with only 0.8M trainable parameters. Our project is available at https://github.com/YMlinfeng/MST-CLIPIQA.
