Search papers, labs, and topics across Lattice.
This paper introduces SciQNet, a two-stage multimodal adaptation framework designed for the assessment of scientific image quality, which uniquely balances visual clarity and scientific informativeness. The framework employs domain-adaptive pretraining on scientific document images followed by task-specific fine-tuning that integrates scoring and understanding supervision through innovative methods like instruction tuning and multiple-choice visual question answering. Experimental results demonstrate that the model achieves competitive scores, with a combined SIQA score of 69.80, highlighting the significance of pretraining-data relevance over mere scale in enhancing performance.
Pretraining on relevant scientific images can significantly boost quality assessment performance, outperforming larger datasets.
Scientific images are essential for communicating experimental observations, quantitative evidence and conceptual knowledge. Unlike natural images, their quality depends on both visual clarity and scientific informativeness, making assessment challenging. In this work, we present SciQNet, a two-stage multimodal adaptation framework for scientific image quality assessment. The first stage performs domain-adaptive pretraining on scientific document images and the second stage conducts task-specific fine-tuning with joint scoring and understanding supervision. For scoring-oriented supervision, we combine instruction tuning with a Huber loss derived from rating-word logits, while understanding-oriented supervision is formulated as multiple-choice visual question answering. Experiments show that using a 40% stratified subset of the domain-adaptive data gives the best performance among the evaluated pretraining fractions, suggesting that pretraining-data relevance may be as important as pretraining-data scale. The final model achieves an SIQA-S score of 92.21, an SIQA-U score of 47.38 and a combined score of 69.80. This work presents our solution to the ICME 2026 Scientific Image Quality Assessment Challenge, which ranked 2nd in the scoring track.
