Search papers, labs, and topics across Lattice.
The paper introduces EagleVision, a new LiDAR-based benchmark for 3D object detection and trajectory prediction specifically designed for the challenges of high-speed autonomous racing. It provides a unified evaluation protocol and newly annotated data across real-world racing, simulated racing, and urban driving scenarios. Experiments using a dataset-centric transfer framework demonstrate that pre-training on real racing data yields the best detection performance, while models trained on a broader motion distribution from the Indy dataset generalize better for trajectory prediction in the A2RL environment.
Autonomous racing perception isn't just about speed; EagleVision reveals that motion distribution coverage trumps in-domain training for trajectory prediction, while real-world pre-training beats simulation for object detection.
High-speed autonomous racing presents extreme perception challenges, including large relative velocities and substantial domain shifts from conventional urban-driving datasets. Existing benchmarks do not adequately capture these high-dynamic conditions. We introduce EagleVision, a unified LiDAR-based multi-task benchmark for 3D detection and trajectory prediction in high-speed racing, providing newly annotated 3D bounding boxes for the Indy Autonomous Challenge dataset (14,893 frames) and the A2RL Real competition dataset (1,163 frames), together with 12,000 simulator-generated annotated frames, all standardized under a common evaluation protocol. Using a dataset-centric transfer framework, we quantify cross-domain generalization across urban, simulator, and real racing domains. Urban pretraining improves detection over scratch training (NDS 0.72 vs. 0.69), while intermediate pretraining on real racing data achieves the best transfer to A2RL (NDS 0.726), outperforming simulator-only adaptation. For trajectory prediction, Indy-trained models surpass in-domain A2RL training on A2RL test sequences (FDE 0.947 vs. 1.250), highlighting the role of motion-distribution coverage in cross-domain forecasting. EagleVision enables systematic study of perception generalization under extreme high-speed dynamics. The dataset and benchmark are publicly available at https://avlab.io/EagleVision
