Search papers, labs, and topics across Lattice.
This paper introduces a comprehensive multi-view in-cabin monitoring dataset specifically designed for public transport vehicles, featuring synchronized RGB and depth images from four cameras and a rotating LiDAR system within a German city bus. The dataset comprises 9,136 samples with detailed annotations and includes a calibration and pseudo-labeling pipeline that facilitates the generation of 3D human pose estimates and oriented bounding boxes for occupants. By benchmarking state-of-the-art multi-view 3D detection models, the authors provide a valuable resource for advancing in-cabin perception research and applications in automated public transport systems.
A new dataset reveals the potential for precise multi-view 3D detection in public transport, paving the way for safer and smarter automated vehicles.
We introduce a multi-view in-cabin monitoring dataset for public transportation with synchronized RGB and depth images from four inward-facing cameras and a rotating LiDAR covering the vehicle interior of a digitalized and partly automated German city bus. The dataset contains 9.136 synchronized samples with annotations and is accompanied by a calibration and pseudo-labeling pipeline that generates 3D human pose estimates and oriented 3D bounding boxes for occupants. We further provide a nuScenes-format conversion and benchmark representative multi-view 3D detection models (e.g., Lift-Splat-Shoot and BEVFusion), supporting comparative evaluation and small-scale training of multi-view in-cabin perception models. The dataset and tools are available at https://github.com/EvgenyGorelik/multiview_incabin_dataset.