Search papers, labs, and topics across Lattice.
This paper addresses the challenge of transferring motion prediction knowledge from synthetic to real-world data in autonomous driving systems, which is hindered by the high cost of real-world motion labels. The authors introduce a novel framework that combines objectness-aware motion prediction and objectness-aided motion enhancement to improve the reliability of knowledge translation across domains. Their approach, validated on the newly created Motion4D dataset, significantly enhances performance in real-world scenarios by effectively mitigating the synthetic-to-real domain shift.
Bridging the gap between synthetic and real-world motion prediction, this framework achieves superior performance by leveraging objectness priors to refine motion labels.
Motion understanding is critical for ensuring safety and robustness in autonomous driving systems, driving increasing interest in motion prediction. A key challenge in this domain is the high cost associated with acquiring real-world motion labels. It is therefore ideal if we could transfer motion knowledge from synthetic data to real data. In this context, we explore the potential of synthetic-to-real translation for motion prediction (SRMP). However, the most used naive motion regression methods are notably sensitive to the synthetic-to-real domain shift, resulting in unreliable knowledge translation. To address this, we propose a novel approach integrating a motion knowledge translation framework with two key components: (1) objectness-aware motion prediction, which explicitly models the joint distribution of motion patterns and objectness priors to improve domain-invariant feature learning, and (2) objectness-aided motion enhancement, a motion label refinement mechanism that leverages learned objectness priors to filter motion noise. Furthermore, we present a physically-based pipeline for generating Motion4D, the first synthetic 4D LiDAR dataset tailored for SRMP research, addressing the lack of synthetic motion datasets. Experimental results demonstrate that our approach effectively bridges the domain gaps and yields superior performance on real scenes.
