Search papers, labs, and topics across Lattice.
This paper introduces VQ-VAD, a novel framework for Video Anomaly Detection (VAD) that utilizes vector-quantized motion representations to improve the detection of anomalies in human-centric video data. By adapting the Vector-Quantized GAN (VQ-GAN) to operate on keypoint sequences, VQ-VAD constructs a motion codebook from normal behavior, enabling the identification of anomalies through high reconstruction errors. Extensive experiments demonstrate VQ-VAD's strong performance across various benchmarks, achieving 81.83% accuracy in in-domain settings and effective cross-domain transfer without retraining.
High reconstruction errors in VQ-VAD reveal anomalies in human motion, achieving 81.83% accuracy in detecting video anomalies from normal behavior patterns.
Video Anomaly Detection (VAD) is inherently challenging due to the scarcity of anomalies and the large visual variability in surveillance footage, including changes in lighting, viewpoint, and human appearance. To mitigate visual noise and address privacy concerns, recent work has shifted to pose-based VAD, which focuses on motion dynamics rather than raw video data. However, existing pose-based approaches model human behavior in continuous latent spaces, limiting their ability to learn compact motion patterns necessary for robust behavior analysis. We address this by proposing Vector-Quantized Video Anomaly Detection (VQ-VAD), a novel human-centric anomaly detection framework that learns discrete motion representations. VQ-VAD adapts Vector-Quantized GAN (VQ-GAN), originally developed for image generation, to operate on keypoint sequences and construct a motion codebook of normal behavior. Trained exclusively on normal motion sequences, VQ-VAD detects anomalies by identifying high reconstruction errors when an observed motion sequence cannot be mapped to the learned codebook. We conduct extensive experiments across three complementary evaluation settings, including in-domain, cross-domain, and cross-dataset generalization, on four anomaly detection benchmarks. VQ-VAD achieves strong in-domain accuracy (81.83% on HR-SHT [15]), effective cross-domain transfer from CMU Panoptic [14] (76.69% on HR-SHT [15] without retraining), and competitive cross-dataset robustness. The code base for this work is available at https://github.com/TeCSAR-UNCC/VQ-VAD.
