Search papers, labs, and topics across Lattice.
This paper addresses the challenge of Incomplete Multi-View Anomaly Detection (IMVAD) by introducing the IMMoE framework, which effectively utilizes incomplete view information through a novel Multi-View Expert Fusion (MVEF) and a Local Anomaly Enhancement Encoder (LAEE). By generating the RIMAD dataset, the authors demonstrate that their approach significantly improves anomaly detection performance, achieving state-of-the-art results with increases of 11.8% in pixel-level metrics and 2.8% in image-level metrics on this dataset. The findings highlight the importance of addressing missing view data in real-world scenarios, providing a robust solution for industrial applications.
IMMoE boosts anomaly detection performance by over 11% even when critical view information is missing, redefining expectations for real-world applications.
Existing Multi-view Anomaly Detection (MAD) methods assume that all views are completely available and model each view separately. However, in real industrial scenarios, information in the view may be missing due to faults such as occlusion, which leads to the performance degradation of existing methods due to the lack of a multi-view consistency prior. To address this, we explored a more challenging task: Incomplete Multi-View Anomaly Detection (IMVAD), in which some areas of each view were masked. We proposed a pipeline for automatically generating the IMVAD dataset and generated the \textbf{RIMAD} dataset based on the Real-IAD dataset through this pipeline. In addition, in order to effectively utilize the information of multiple views in the absence of view information, we propose \textbf{IMMoE}, which consists of two key modules: (1) Multi-View Expert Fusion (MVEF) effectively fuses multi-view information through a multi-view expert network and guides the reconstruction of a single view; (2) Local Anomaly Enhancement Encoder (LAEE) effectively prevents the model from overfitting the mask region by applying dropout to local features. Our method achieves state-of-the-art performance on both the RIMAD and Real-IAD datasets, especially on RIMAD, we have increased the pixel-level and image-level metrics by 11.8\% and 2.8\%, respectively. Our source code is available at https://github.com/HULEI7/IMMoE
