Search papers, labs, and topics across Lattice.
The paper introduces VRUD, a new drone-based dataset focused on complex interactions between vehicles and vulnerable road users (VRUs) in unstructured urban environments, specifically "Urban Villages" in Shenzhen. VRUD contains 4 hours of 4K/30Hz video with a high density of VRUs (87% of traffic participants) and extracted 4,002 multi-agent interaction scenarios using a novel Vector Time to Collision (VTTC) threshold. By providing data from chaotic, real-world urban settings with extreme occlusion, VRUD aims to address the limitations of existing datasets and enhance the safety performance of autonomous driving systems (ADS) in challenging scenarios.
Autonomous vehicles still struggle with jaywalkers and unpredictable pedestrian behavior, and this new dataset of chaotic urban environments could be the key to teaching them.
The Operational Design Domain (ODD) of urbanoriented Level 4 (L4) autonomous driving, especially for autonomous robotaxis, confronts formidable challenges in complex urban mixed traffic environments. These challenges stem mainly from the high density of Vulnerable Road Users (VRUs) and their highly uncertain and unpredictable interaction behaviors. However, existing open-source datasets predominantly focus on structured scenarios such as highways or regulated intersections, leaving a critical gap in data representing chaotic, unstructured urban environments. To address this, this paper proposes an efficient, high-precision method for constructing drone-based datasets and establishes the Vehicle-Vulnerable Road User Interaction Dataset (VRUD), as illustrated in Figure 1. Distinct from prior works, VRUD is collected from typical"Urban Villages"in Shenzhen, characterized by loose traffic supervision and extreme occlusion. The dataset comprises 4 hours of 4K/30Hz recording, containing 11,479 VRU trajectories and 1,939 vehicle trajectories. A key characteristic of VRUD is its composition: VRUs account for about 87% of all traffic participants, significantly exceeding the proportions in existing benchmarks. Furthermore, unlike datasets that only provide raw trajectories, we extracted 4,002 multi-agent interaction scenarios based on a novel Vector Time to Collision (VTTC) threshold, supported by standard OpenDRIVE HD maps. This study provides valuable, rare edge-case resources for enhancing the safety performance of ADS in complex, unstructured urban environments. To facilitate further research, we have made the VRUD dataset open-source at: https://zzi4.github.io/VRUD/.
