Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces RAMSAD, a retrieval-based framework for time-series anomaly detection model selection, addressing the performance degradation of existing methods in Out-of-Distribution (OOD) settings. By querying a knowledge base of past time series and transferring detector performance profiles from similar instances, RAMSAD achieves superior performance in both In-Distribution (ID) and OOD scenarios. Notably, RAMSAD matches or surpasses ensemble methods with a fraction of the computational cost in OOD settings, demonstrating the efficacy of similarity-based retrieval for robust model selection.
Outperforming traditional model selection, a retrieval-based approach finds the best anomaly detector for unseen time series by leveraging similarity to past data, even in challenging OOD scenarios.
Anomaly detection is a fundamental task for time-series analytics, with important implications for the downstream performance of many applications. Despite the large number of anomaly detection methods proposed in the literature, recent benchmark studies have shown that no single detector performs best across highly heterogeneous time series. Therefore, a practical and scalable solution is to develop a model-selection method that, for a given time series, selects the anomaly detector most likely to perform well. Nevertheless, the model selection approaches proposed in the literature suffer from a significant drop in accuracy when applied in Out-of-Distribution (OOD) settings. In this paper, we tackle the aforementioned limitation and propose RAMSAD, a retrieval-based framework for model selection in time-series anomaly detection. Given a new time series, our method queries a knowledge base of previously observed instances, retrieves the top-k most similar series, and transfers detector recommendations from their performance profiles. The framework can operate with standard similarity measures as well as embedding-based representations. Our results show that RAMSAD outperforms existing baselines in In-Distribution (ID) settings and is the most robust selector in OOD, where, when selecting a small subset of detectors, it matches or exceeds ensembles that run the entire detector pool, at a fraction of their cost. Overall, we demonstrate that similarity-based retrieval constitutes a strong and efficient foundation for model selection in time-series anomaly detection.