Search papers, labs, and topics across Lattice.
The paper introduces IndoorCrowd, a new multi-scene dataset for indoor human detection, instance segmentation, and multi-object tracking, comprising 9,913 frames across four campus locations with human-verified annotations. The dataset benchmarks the performance of SAM3, GroundingSAM, and EfficientGroundingSAM for automated annotation using metrics like Cohen's $\kappa$ and mask IoU, revealing their limitations in complex indoor scenes. Baseline detection, segmentation, and tracking models are established using YOLOv8n, YOLOv26n, RT-DETR-L, ByteTrack, BoT-SORT, and OC-SORT, highlighting the dataset's difficulty due to variations in crowd density, scale, and occlusion.
Foundation models still struggle to automatically annotate complex indoor crowd scenes, leaving ample room for improvement in automated annotation pipelines.
Understanding human behaviour in crowded indoor environments is central to surveillance, smart buildings, and human-robot interaction, yet existing datasets rarely capture real-world indoor complexity at scale. We introduce IndoorCrowd, a multi-scene dataset for indoor human detection, instance segmentation, and multi-object tracking, collected across four campus locations (ACS-EC, ACS-EG, IE-Central, R-Central). It comprises $31$ videos ($9{,}913$ frames at $5$fps) with human-verified, per-instance segmentation masks. A $620$-frame control subset benchmarks three foundation-model auto-annotators: SAM3, GroundingSAM, and EfficientGroundingSAM, against human labels using Cohen's $\kappa$, AP, precision, recall, and mask IoU. A further $2{,}552$-frame subset supports multi-object tracking with continuous identity tracks in MOTChallenge format. We establish detection, segmentation, and tracking baselines using YOLOv8n, YOLOv26n, and RT-DETR-L paired with ByteTrack, BoT-SORT, and OC-SORT. Per-scene analysis reveals substantial difficulty variation driven by crowd density, scale, and occlusion: ACS-EC, with $79.3\%$ dense frames and a mean instance scale of $60.8$px, is the most challenging scene. The project page is available at https://sheepseb.github.io/IndoorCrowd/.