Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a lightweight two-stage framework for real-time video anomaly detection that combines YOLO v11n-pose for skeletal keypoint extraction with CLIP-based semantic scoring for behavior analysis. By eliminating the reliance on optical flow and other complex modules, the proposed method achieves a significant speedup of 3.36x over traditional multi-feature approaches while maintaining high accuracy, as evidenced by frame-level AUROC scores across multiple datasets. The framework operates at approximately 51 FPS on an NVIDIA Titan XP GPU, making it suitable for real-time applications.
Achieving 51 FPS for video anomaly detection without sacrificing accuracy, this framework redefines efficiency in real-time surveillance systems.
We propose a lightweight two-stage framework for real-time video anomaly detection. The first stage employs YOLO v11n-pose to detect persons and extract seventeen skeletal keypoints in a single forward pass. The second stage encodes each cropped person region through CLIP ViT-B/32 and computes cosine similarity against predefined textual descriptions of anomalous behaviors. This architecture eliminates the need for optical flow, standalone pose estimators, and density-based scoring modules. Experiments on CUHK Avenue, ShanghaiTech Campus, and a custom indoor dataset collected at Chulalongkorn University demonstrate an end-to-end throughput of approximately 51 FPS on an NVIDIA Titan XP GPU, a 3.36x speedup over the multi-feature baseline, while maintaining frame-level AUROC values of 89.26%, 70.26%, and 84.13%, respectively.