Search papers, labs, and topics across Lattice.
This paper introduces STEP, a novel framework for Skeleton-based Video Anomaly Detection (VAD) that leverages Principal Component Analysis (PCA) to project pose sequences into a compact, whitened PC-space, thereby addressing the issue of physically impossible poses caused by noise injection in raw joint coordinates. By learning the data density in this well-behaved space, STEP enables the model to effectively process longer video sequences without performance degradation, while also incorporating a sequence-level weighting mechanism to counteract pose estimation inaccuracies. The framework achieves a significant performance boost, outperforming the state-of-the-art by 12.2% on the UBnormal dataset and demonstrating competitive results on the ShanghaiTech benchmark.
STEP transforms pose anomaly detection by ensuring that noise injection leads to physically plausible variations, enabling robust performance on longer video sequences.
Skeleton-based Video Anomaly Detection (VAD) offers a robust, privacy-preserving solution for identifying abnormal behaviors. To model the distribution of normal static and moving poses, recent methods train Energy-Based Models (EBMs) via Denoising Score Matching (DSM). However, directly injecting noise, required for training, into raw joint coordinates creates physically impossible poses, and this structural collapse severely worsens as the temporal window expands. To address this, we introduce STEP, a simple framework that utilizes Principal Component Analysis (PCA) to project pose sequences into a compact, whitened PC-space. Learning the data density within this well-behaved PC-space ensures that the injected noise translates into physically plausible variations, which allows the model to process longer video sequences without the performance collapse of raw coordinate baselines. Additionally, to mitigate inherent pose estimation inaccuracies arising from occlusions or motion blur, we integrate a sequence-level weighting mechanism based on the estimator's confidence scores. Operating at real-time computational efficiency, our simple and lightweight framework outperforms the previous skeleton-based state-of-the-art by 12.2% (90.1% AUROC) on the challenging UBnormal dataset and achieves highly competitive results by improving on the ShanghaiTech benchmark.
