Search papers, labs, and topics across Lattice.
The paper introduces PINNS, a new dataset for pedestrian-vehicle interaction prediction in unstructured environments, addressing the lack of data capturing complex, heterogeneous interactions beyond structured road settings. PINNS comprises video data from uncalibrated surveillance cameras across diverse global locations and conditions, annotated with trajectory and scene-level information according to a Chinese Association of Automation standard. Analysis using PINNS highlights challenges in heterogeneous agent trajectory prediction, demonstrating the dataset's utility for advancing autonomous driving research in complex mixed traffic scenarios.
Finally, a dataset that captures the messy reality of pedestrian-vehicle interactions in unstructured environments, moving beyond the limitations of structured road data.
Predicting the interaction between pedestrian and vehicle is essential for autonomous driving safety in unstructured and semi-structured scenarios; however, this task is severely hindered by the scarcity of public datasets that feature dense pedestrian-vehicle interactions. Most current studies rely on structured road data, leaving the complex, heterogeneous interactions found in unstructured environments insufficiently represented and researched. In this paper, we propose a dataset annotation framework based on video data from uncalibrated surveillance cameras and present PINNS (Pedestrian-vehicle Interaction dataset from uNcalibrated cameras in uNstructured Scenes). The dataset covers multiple countries and regions, includes diverse typical traffic scenarios, and considers variations in seasons, lighting conditions, and weather. It focuses on complex scenes with dense pedestrian-vehicle interactions and is designed to be easily extensible. The dataset is constructed and annotated according to the standard issued by the Chinese Association of Automation, providing both trajectory data and corresponding scene-level information. Furthermore, this paper analyzes current challenges and research directions in heterogeneous agent trajectory prediction, shows the necessity and usefulness of the proposed dataset. We hope our framework and dataset will facilitate research on trajectory prediction and autonomous driving in complex mixed traffic scenarios. PINNS is publicly available at https://github.com/Songan-Lab.
