Search papers, labs, and topics across Lattice.
The authors introduce eAP, a large-scale dataset for event-enhanced autonomous perception, designed to address the limitations of visual systems in challenging illumination. They demonstrate the dataset's utility by improving a 3D vehicle detection network using event data and enabling a geometry-aware representation learning framework for object time-to-contact (TTC) estimation. Experiments show that eAP facilitates the development of event-based perception models, achieving state-of-the-art TTC estimation at 200 FPS and enhancing 3D object detection in difficult lighting.
Event cameras can now see in the dark: eAP, a new large-scale dataset, enables robust 3D object detection and time-to-contact estimation even under challenging illumination.
Recent visual autonomous perception systems achieve remarkable performances with deep representation learning. However, they fail in scenarios with challenging illumination.While event cameras can mitigate this problem, there is a lack of a large-scale dataset to develop event-enhanced deep visual perception models in autonomous driving scenes. To address the gap, we present the eAP (event-enhanced Autonomous Perception) dataset, the largest dataset with event cameras for autonomous perception. We demonstrate how eAP can facilitate the study of different autonomous perception tasks, including 3D vehicle detection and object time-to-contact (TTC) estimation, through deep representation learning. Based on eAP, we demonstrate the ffrst successful use of events to improve a popular 3D vehicle detection network in challenging illumination scenarios. eAP also enables a devoted study of the representation learning problem of object TTC estimation. We show how a geometryaware representation learning framework leads to the best eventbased object TTC estimation network that operates at 200 FPS. The dataset, code, and pre-trained models will be made publicly available for future research.
