Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper addresses the limitations of traditional trajectory forecasting models that rely on clean, annotated histories by introducing an uncertainty-aware approach that incorporates the reliability of imperfect multi-object tracking data. By modeling observed states as Gaussian distributions that account for both localization uncertainty and data association ambiguity, the authors enhance the robustness of predictions in real-world scenarios. Experiments demonstrate that this method significantly improves displacement accuracy and the reliability-sharpness trade-off in probabilistic forecasts across multiple datasets.
Incorporating uncertainty from imperfect tracking data can dramatically enhance trajectory forecasting accuracy in real-world applications.
Most trajectory forecasting models are trained on clean annotated histories, and are often evaluated under the same idealized assumption, although practical deployments rely on trajectories produced by imperfect multi-object trackers. The real-world observations exhibit localization jitter, missed or unstable detections, and data-association ambiguity, which are usually either ignored or removed through denoising. This paper instead treats tracking-derived reliability cues as an informative signal to be propagated to the predictor. We propose a plug-in uncertainty-aware formulation in which each observed state is encoded as an uncertain state representation, modeled by a Gaussian distribution whose covariance combines detection-level localization uncertainty and association-level ambiguity through the law of total variance. Existing backbones are adapted with minimal architectural changes: input trajectories are represented as Gaussian observations, and predicted trajectories are produced as Gaussian forecasts rather than deterministic coordinates. To train predictors that remain robust under structured observation noise, we combine temporally correlated Ornstein-Uhlenbeck perturbations with response-based knowledge distillation from a teacher trained on clean trajectories. Experiments on Oxford Town Centre and VIRAT using real tracker outputs, together with a complementary ETH/UCY pseudo-detection protocol, show that the proposed formulation improves displacement accuracy and the reliability-sharpness trade-off of probabilistic forecasts.