Search papers, labs, and topics across Lattice.
ARCANE-PedSynth, a CARLA-based framework, generates synthetic multi-pedestrian datasets for autonomous driving research by employing a hybrid AI-manual pedestrian control architecture to overcome CARLA's low native pedestrian crossing rate. This framework uses a 12-state behavioural finite state machine and five character archetypes to produce diverse and configurable crossing behaviors, achieving crossing rates up to 75%. The resulting datasets, like PedSynth++, include synchronized RGB, LiDAR, and DVS data with dense annotations such as per-frame crossing labels, behavioral states, and 2D pose keypoints.
Overcome the sim-to-real gap in pedestrian crossing prediction with a new framework that cranks CARLA's pedestrian crossing rate from a measly 9% to a configurable 75%.
We present ARCANE-PedSynth, an open-source CARLA-based software framework for generating synthetic multi-pedestrian datasets with dense behavioural annotations for pedestrian crossing prediction in autonomous driving. The framework overcomes CARLA's native 9% crossing rate through a hybrid AI-manual pedestrian control architecture, enabling configurable target rates up to 75%. A 12-state behavioural finite state machine with five character archetypes produces diverse crossing behaviours. The framework generates synchronised RGB, LiDAR, and DVS data with per-frame crossing labels, behavioural states, and estimated 2D pose keypoints. We demonstrate ARCANE-PedSynth through PedSynth++, an example dataset generated with the framework, comprising 533 multi-pedestrian clips across 12 weather conditions with RGB, LiDAR, and DVS streams. ARCANE-PedSynth is fully reproducible via CLI parameterisation and Docker containerisation.