Search papers, labs, and topics across Lattice.
EgoPolice is a novel dataset designed for egocentric video understanding, specifically focused on police-civilian interactions captured through body-worn cameras. The dataset features second-by-second annotations of critical actions in challenging conditions, revealing that even state-of-the-art models like Gemini 2.5 Pro fail to reliably identify high-risk actions such as "Weapon Out." This research underscores the need for improved motion-robust and context-aware models in high-stakes environments, paving the way for better event detection in police footage.
Even top-performing video models struggle to identify critical high-risk actions in police body-worn camera footage, highlighting a significant gap in current AI capabilities.
We introduce EgoPolice, a carefully curated dataset of real, egocentric police-civilian interactions, sourced from publicly available body-worn camera videos. We select police-civilian action labels that are critical for police behavioral research and annotate them at a second-by-second granularity. The videos feature rapid and irregular camera motion, dense human interactions, and rare high-stakes events, making the dataset a challenging benchmark for motion-robust and context-aware egocentric perception. We provide two different tasks, classification and multiple-choice question-answering, and benchmark both open-source and closed-source models. We find that even the best video models like Gemini 2.5 Pro still struggle to accurately predict high-risk actions such as "Weapon Out". Beyond serving as a benchmark, EgoPolice provides a foundation for developing models capable of identifying events of interest in large-scale body-worn camera video repositories, enabling more efficient downstream human review.
