Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces WSADBench, a unified benchmark for weakly supervised anomaly detection (WSAD) across incomplete, inexact, and inaccurate supervision scenarios. The benchmark evaluates 36 algorithms across 4 modalities, systematically varying label quantity, granularity, and quality through over 700K experiments. Results show strong correlations between weak supervision scenarios, the dominance of tabular foundation models over specialized WSAD methods with sufficient supervision, inconsistent utility of unlabeled data, and asymmetric sensitivity to label noise types.
Seemingly distinct approaches to weakly supervised anomaly detection are more alike than different, and often outperformed by standard tabular models given sufficient (even weak) supervision.
Weakly supervised anomaly detection (WSAD) has developed in three primary directions: incomplete, inexact, and inaccurate supervision. However, these directions remain isolated, lacking a unified framework to assess whether they address unique challenges or share fundamental mechanics. This paper introduces WSADBench, the first benchmark that unifies evaluation across distinct weakly supervised scenarios, benchmarking diverse approaches from specialized WSAD methods to advanced tabular foundation models. WSADBench establishes standardized protocols to evaluate 36 algorithms across 4 modalities by systematically varying label quantity, granularity, and quality, revealing the performance boundaries of various methods. Based on over 700K experiments, WSADBench reveals four critical insights: (i) Strong intrinsic correlations exist between these weak supervision scenarios, challenging the isolation of current research directions. (ii) Specialized WSAD algorithms excel only in extreme label-scarcity regimes but are quickly dominated by tabular foundation models and general classification methods as supervision increases or in OOD scenarios. (iii) Unlabeled data shows inconsistent utility across settings, with marginal gains compared to label refinement. (iv) Models exhibit asymmetric sensitivity to different types of label noise. We release WSADBench as an open-source benchmark with code and datasets to facilitate future WSAD research: https://github.com/SUFE-AILAB/WSADBench.