Search papers, labs, and topics across Lattice.
This paper introduces HAJJv2-CrowdCount, a zero-shot benchmark specifically designed for dense crowd counting in Hajj video footage, which presents unique challenges due to steep camera angles and extensive occlusion. By providing per-second human-annotated crowd counts for the HAJJv2 dataset, the authors evaluate three zero-shot counting paradigms: YOLO-World, APGCC, and SAM3Count, revealing that while SAM3Count performs best overall, the point-based counter APGCC shows superior resilience in the most challenging, densely populated frames. This finding is critical for effective crowd management during Hajj, where accurate crowd counts are essential in high-density scenarios.
In the most challenging crowd scenarios, a point-based counter outperforms traditional detection and segmentation methods, revealing a critical insight for real-world applications in crowd management.
Automated crowd counting in Hajj video is difficult not because current models lack capacity, but because the footage violates the assumptions those models were built on: cameras observe the crowd from steep, near-vertical angles, individuals occlude one another extensively, and a single frame can contain well over a thousand people. Benchmarks that test crowd counting in such an environment are either private or not detailed per second. We revisit the HAJJv2 dataset and contribute HAJJv2-CrowdCount: per-second human-annotated crowd counts for its testing videos. Using these annotations, we benchmark three recent zero-shot counting paradigms: an open-vocabulary detector (YOLO-World), a point-based counter (APGCC), and a promptable segmentation-based counter (SAM3Count). SAM3Count attains the lowest overall mean absolute error (MAE 70.4, 95% CI 56.0-86.1), ahead of YOLO-World (92.0) and APGCC (152.9). This ordering reverses, however, in the regime most relevant to deployment: on the densest frames, the detection- and segmentation-based counters both degrade sharply (MAE exceeding 300), while the point-based counter degrades far more gracefully (MAE 114.9). This inversion is decision-relevant for Hajj crowd management, where reliable counts are needed most precisely in the densest and most occluded scenes. The annotations are released to support reproduction and extension of these results.
