Search papers, labs, and topics across Lattice.
This paper evaluates the zero-shot performance of multimodal large language models (MLLMs) on video anomaly detection (VAD) using the ShanghaiTech and CHAD datasets. By reformulating VAD as a language-guided reasoning task with weak temporal supervision, the study reveals a strong conservative bias in MLLMs, leading to high precision but poor recall in zero-shot settings. The authors demonstrate that class-specific prompting can improve F1-score, but recall remains a significant challenge, highlighting the need for improved prompting strategies and model calibration for real-world surveillance applications.
MLLMs, despite their video understanding prowess, exhibit a surprisingly strong "better safe than sorry" bias when detecting anomalies in video, crippling their recall in real-world surveillance scenarios.
Multimodal large language models (MLLMs) have demonstrated impressive general competence in video understanding, yet their reliability for real-world Video Anomaly Detection (VAD) remains largely unexplored. Unlike conventional pipelines relying on reconstruction or pose-based cues, MLLMs enable a paradigm shift: treating anomaly detection as a language-guided reasoning task. In this work, we systematically evaluate state-of-the-art MLLMs on the ShanghaiTech and CHAD benchmarks by reformulating VAD as a binary classification task under weak temporal supervision. We investigate how prompt specificity and temporal window lengths (1s--3s) influence performance, focusing on the precision--recall trade-off. Our findings reveal a pronounced conservative bias in zero-shot settings; while models exhibit high confidence, they disproportionately favor the'normal'class, resulting in high precision but a recall collapse that limits practical utility. We demonstrate that class-specific instructions can significantly shift this decision boundary, improving the peak F1-score on ShanghaiTech from 0.09 to 0.64, yet recall remains a critical bottleneck. These results highlight a significant performance gap for MLLMs in noisy environments and provide a foundation for future work in recall-oriented prompting and model calibration for open-world surveillance, which demands complex video understanding and reasoning.
