Search papers, labs, and topics across Lattice.
This paper introduces a multi-modal late-fusion perception pipeline designed for object detection and tracking in autonomous racing, addressing the challenges posed by high-speed environments and adverse conditions. By integrating data from cameras, LiDARs, and RADARs, the system provides robust state estimates while compensating for detection delays through a dedicated multi-object tracking framework that incorporates vehicle dynamics and track layout knowledge. Experimental results demonstrate its effectiveness in real-world scenarios, highlighting its potential for enhancing safety and adaptability in autonomous driving applications.
Real-time object detection and tracking in autonomous racing can be achieved with a multi-modal fusion approach that significantly improves performance under challenging conditions.
Object detection and tracking are fundamental components of perception systems for autonomous driving. Achieving robust performance under adverse conditions such as limited visibility, sensor noise, and failures remains an open challenge, particularly in autonomous racing, where vehicles operate at very high speeds, experience strong vibrations, and interact under small safety margins. This paper presents a multi-modal late-fusion perception pipeline for object detection and tracking in the autonomous racing domain. The proposed system extends previous work by exploiting all onboard sensors through a late-fusion approach and a dedicated multi-object tracking framework. Independent detections from cameras, LiDARs, and RADARs are combined to provide timely and robust state estimates of surrounding vehicles. The tracking method explicitly compensates for detection delays and embeds in its model prior knowledge of vehicle dynamics and track layout. Experimental evaluation on real-world data across diverse critical scenarios, representative of challenging edge cases also in urban driving, confirms the effectiveness of the proposed pipeline and its suitability to support safe and adaptive planning decisions.
