Search papers, labs, and topics across Lattice.
The paper introduces CMDR-IAD, a novel unsupervised framework for 2D-3D multimodal industrial anomaly detection that overcomes limitations of existing methods by avoiding memory banks and fragile fusion schemes. CMDR-IAD uses bidirectional cross-modal mapping between 2D and 3D data, combined with dual-branch reconstruction to independently model texture and geometry. The framework achieves state-of-the-art performance on the MVTec 3D-AD benchmark (97.3% I-AUROC, 99.6% P-AUROC) and strong results on a real-world polyurethane cutting dataset, demonstrating robustness and modality flexibility.
Forget fragile fusion schemes: a new cross-modal mapping and dual-branch reconstruction approach achieves state-of-the-art anomaly detection in industrial settings, even with noisy or missing depth data.
Multimodal industrial anomaly detection benefits from integrating RGB appearance with 3D surface geometry, yet existing \emph{unsupervised} approaches commonly rely on memory banks, teacher-student architectures, or fragile fusion schemes, limiting robustness under noisy depth, weak texture, or missing modalities. This paper introduces \textbf{CMDR-IAD}, a lightweight and modality-flexible unsupervised framework for reliable anomaly detection in 2D+3D multimodal as well as single-modality (2D-only or 3D-only) settings. \textbf{CMDR-IAD} combines bidirectional 2D$\leftrightarrow$3D cross-modal mapping to model appearance-geometry consistency with dual-branch reconstruction that independently captures normal texture and geometric structure. A two-part fusion strategy integrates these cues: a reliability-gated mapping anomaly highlights spatially consistent texture-geometry discrepancies, while a confidence-weighted reconstruction anomaly adaptively balances appearance and geometric deviations, yielding stable and precise anomaly localization even in depth-sparse or low-texture regions. On the MVTec 3D-AD benchmark, CMDR-IAD achieves state-of-the-art performance while operating without memory banks, reaching 97.3\% image-level AUROC (I-AUROC), 99.6\% pixel-level AUROC (P-AUROC), and 97.6\% AUPRO. On a real-world polyurethane cutting dataset, the 3D-only variant attains 92.6\% I-AUROC and 92.5\% P-AUROC, demonstrating strong effectiveness under practical industrial conditions. These results highlight the framework's robustness, modality flexibility, and the effectiveness of the proposed fusion strategies for industrial visual inspection. Our source code is available at https://github.com/ECGAI-Research/CMDR-IAD/
