Search papers, labs, and topics across Lattice.
This paper introduces Linguistic Relative Policy Optimization (LRPO), a novel approach for video anomaly detection that minimizes reliance on large-scale annotations by leveraging group-relative semantic advantages from multiple reasoning trajectories. By integrating a linguistically expressed anomaly experience prior into the model's context without requiring parameter updates, LRPO effectively captures both general and scenario-specific anomaly preferences. Experimental results on benchmark datasets, including XD-Violence and UCF-Crime, reveal that LRPO outperforms existing state-of-the-art methods in tuning-free settings, highlighting its efficiency and effectiveness in anomaly reasoning.
LRPO achieves superior video anomaly detection by learning from multiple reasoning trajectories without the need for extensive human annotations.
Video anomaly detection (VAD) with multimodal large language models has shown strong potential, yet most existing methods still depend on large-scale annotations or expert-designed priors, limiting their ability to acquire anomaly knowledge with as little human intervention as possible. To address this, we propose Linguistic Relative Policy Optimization (LRPO), which distills group-relative semantic advantages from multiple reasoning trajectories into a linguistically expressed anomaly experience prior, and adapts the model by injecting this prior into the context to steer its output distribution without any parameter updates. LRPO builds two complementary experience representations: general experience captures transferable anomaly preferences across scenarios, while scenario experience models context-dependent anomaly rules for targeted refinement. To further improve the learned experience, we introduce an anomaly alignment reward that guides trajectory optimization to match human risk preferences and reinforce temporally grounded reasoning. Extensive experiments on XD-Violence, UCF-Crime, and UBnormal demonstrate that LRPO significantly outperforms existing state-of-the-art methods under tuning-free settings.