Search papers, labs, and topics across Lattice.
The paper introduces CMDS-AD, a Cross-Modal Dual-Stream Anomaly Detection framework designed to enhance few-shot anomaly detection by leveraging both RGB and 3D geometric cues. By employing a LoRA-guided diffusion model for RGB sample generation and a pre-trained diffusion model for low-frequency normal estimation, the framework effectively decouples high-frequency defect signals from stable structural representations. This innovative approach results in significant performance improvements, achieving state-of-the-art results in extreme few-shot settings on benchmark datasets like MVTec 3D-AD and EyeCandies.
Achieving a new state-of-the-art in few-shot anomaly detection, CMDS-AD boosts performance by over 5% in extreme settings through innovative cross-modal decoupling.
Few-shot anomaly detection remains challenging due to limited training data. Multi-modal anomaly detection (MAD) offers a viable solution, leveraging 3D geometric cues to enrich 2D RGB representations and compensate for this scarcity. However, existing MAD methods apply spatially uniform feature processing, conflating stable macroscopic structures with high-frequency localized defect signals, exacerbating cross-modal misalignment and inflating false-positive rates. To overcome this, we present CMDS-AD, a Cross-Modal Dual-Stream Anomaly Detection framework. A LoRA-guided diffusion model generates diverse RGB samples to mitigate extreme data scarcity. For 3D normal augmentation, we employ a pre-trained diffusion model as a normal estimator. Crucially, this estimator inherently acts as a non-linear low-pass filter, directly extracting low-frequency normal representations from RGB inputs. This establishes an auxiliary estimated stream of purely low-frequency information, anchoring robust structural templates and assisting the uncompressed real stream, containing coupled high- and low-frequency components, to precisely isolate micro-defects. A Coordinate-Aware Hierarchical Feature Mapper adaptively aligns cross-modal semantics, while a multiplicative scoring mechanism filters modality-specific noise. Under the extreme 1-shot setting, CMDS-AD achieves absolute performance gains of 5.7% (I-AUROC) and 2.0% (AUPRO) on MVTec 3D-AD, alongside 7.7% and 5.6% improvements on EyeCandies, establishing a new state-of-the-art.
