Search papers, labs, and topics across Lattice.
This paper introduces DifferAD-R1, a novel MLLM-augmented reinforcement learning framework designed for industrial anomaly localization, addressing the limitations of traditional methods in detecting unseen defect categories. By reformulating the localization task into a one-shot difference grounding problem and incorporating a Dual-Consistency Localization Reward, the framework enhances the detection of subtle anomalies while ensuring optimization stability. Experimental results show that DifferAD-R1 outperforms existing approaches and competes effectively with large-scale models, demonstrating its practical applicability in real-world industrial scenarios.
A novel approach to anomaly localization that significantly improves detection of subtle defects in industrial products by leveraging multimodal large language models.
Industrial anomaly localization aims to accurately identify and localize abnormal regions in industrial products, addressing the critical challenge of detecting unseen defect categories in real-world scenarios. Traditional closed-set methods often suffer from poor cross-scenario generalization, while existingMultimodal Large Language Model (MLLM)-based approachesface two core limitations: they either adopt QA-style paradigmsmisaligned with the practical demands of localization, or relyon standard optimization techniques such as Group RelativePolicy Optimization (GRPO), which fails to deliver effectivelearning signals for subtle defects. To tackle these issues, thispaper proposes DifferAD-R1, an MLLM-augmented reinforcement learning framework tailored for industrial anomaly localization. We design a Difference-Guided dual-image paradigm,which reformulates the localization task as a one-shot difference grounding problem to effectively explore cross-scenarioanomalies. A Dual-Consistency Localization Reward is developedfor hard-to-detect anomalies, enhancing optimization stabilityand robustness. Additionally, we integrate a difficulty-awarestrategy with adaptive reweighting and group-wise resamplingto prioritize learning on challenging instances. To facilitateevaluations in real-world industrial settings, we construct theAD-DualDiff dataset, comprising 13K paired images across 20categories. Experimental results demonstrate that DifferADR1 significantly outperforms existing baselines and achievescompetitive performance compared to large-scale models likeQwen3-VL (235B parameters). Our code is publicly availableat: https://github.com/Rong2026/work-1.
Tsinghua AI