Search papers, labs, and topics across Lattice.
This paper introduces AgenticVAU, a novel multi-agent framework for video anomaly understanding (VAU) that enhances the detection and verification of anomalous events in videos. By employing four specialized agents that focus on distinct tasks鈥攙isual-rule construction, search planning, video observation, and decision-making鈥擜genticVAU effectively coordinates evidence gathering and improves generalization beyond existing methods. Experimental results on multiple datasets reveal that AgenticVAU significantly outperforms traditional zero-shot inference and reinforcement learning-based approaches, highlighting the advantages of its structured, collaborative reasoning process.
Multi-agent collaboration in video anomaly understanding leads to a significant boost in detection and verification accuracy, outperforming traditional methods.
Video anomaly understanding (VAU) focuses on comprehensively interpreting abnormal events in videos, requiring models to identify anomalous occurrences, discover their supporting evidence, and explain the underlying causes beyond simple anomaly detection. Existing VAU methods often rely on specialized training or limited observations, restricting generalization or evidence coverage. Although single-agent alternatives support adaptive video observation, they still integrate exploration, observation, and decision-making within a unified reasoning process, offering limited role specialization and structured evidence coordination. To address these limitations, we present AgenticVAU, a training-free multi-agent framework that casts VAU as an explore--verify process, where the system first discovers potential anomalies and then verifies them through targeted observations. To achieve this, four specialized agents are introduced to handle visual-rule construction, search planning, video observation, and final decision, respectively. These agents communicate through an anchor registry, a shared evidence memory that binds each observation. Guided by this agent framework, AgenticVAU interleaves broad temporal exploration, dense local verification, and cross-interval comparison until sufficient evidence is collected. We conduct extensive experiments on the ECVA, UCF-Crime, and MSAD subsets of VAU-Bench, the results show that AgenticVAU outperforms zero-shot inference and reinforcement learning-based baselines, demonstrating the value of multi-agent collaboration for video anomaly understanding.
