Search papers, labs, and topics across Lattice.
This study evaluates the performance of four nuScenes-pre-trained LiDAR detectors on a newly created benchmark of 1,027 annotated keyframes from the FUSE-Bike platform, focusing on 3D object detection for vulnerable road users (VRUs) like cyclists and pedestrians. The research reveals that while there is a significant zero-shot domain gap for VRU classes, fine-tuning the detectors with auto-generated labels can recover most of this gap, achieving improvements in mean average precision (mAP) of up to 23.4 points. Notably, the adapted detectors not only match but exceed the quality of the auto-labels used for training, indicating the effectiveness of this approach for enhancing 3D detection in urban environments.
Fine-tuning LiDAR detectors with auto-generated labels can boost VRU detection accuracy by over 23 points, outperforming the original training data quality.
Reliable 3D perception of vulnerable road users (VRUs) such as cyclists and pedestrians is essential for their safety in urban traffic and a core requirement for autonomous driving (AD). Alongside advances in vehicle-based perception, research increasingly equips bicycles with sensors to study traffic from a perspective native to VRUs. Such platforms still rely on LiDAR detectors originally trained on vehicle data, yet annotated 3D data from a cyclist's perspective is scarce. How well these detectors generalise to this setting has not been evaluated. We present a 3D object detection benchmark of 1,027 annotated LiDAR keyframes (over 18,000 3D bounding boxes) from the FUSE-Bike platform in urban Munich. We evaluate four nuScenes-pre-trained detectors against 1,854 human-verified ground-truth (GT) boxes both in their original form and after finetuning on training labels produced by a VRU-dedicated auto-labelling pipeline that requires no manual annotation. The zero-shot domain gap is concentrated on the VRU classes. Finetuning recovers most of it, improving mean average precision (mAP) by up to 23.4 points with the largest gains on pedestrians and cyclists, and the adapted detectors even surpass the quality of the auto-labels they were trained on. The benchmark provides a reproducible baseline for VRU-centric 3D detection and shows that auto-labels are a viable substitute for manual annotation when adapting vehicle-trained detectors to a cyclist platform.
