Search papers, labs, and topics across Lattice.
FutureLift refines multimodal motion forecasting proposals by representing them as heterogeneous future graphs, enabling bidirectional temporal edge updates for a single-pass correction pass. This approach leverages agent histories, map elements, alternative modes, and other agents' trajectories as explicit relational context to revise earlier trajectory segments with later evidence. The refiner consistently improves frozen proposals and outperforms existing methods on benchmark datasets, achieving state-of-the-art results on the Waymo Open Motion Dataset leaderboard for marginal prediction.
Bidirectional future graphs allow later evidence to retroactively correct earlier motion prediction segments, achieving state-of-the-art forecasting accuracy without LiDAR or ensembling.
Accurate motion prediction is critical for safe autonomous driving, yet even strong forecasters leave residual errors in their multimodal proposals. Existing refiners compress complete proposals or update their segments sequentially, preventing the full proposed future from serving as explicit relational context for correction. We introduce FutureLift, a backbone-agnostic refiner that represents each multimodal proposal as a heterogeneous future graph, with spatially grounded temporal nodes connected to agent histories, map elements, alternative modes, and, for joint prediction, other agents future trajectories. Bidirectional temporal edges allow later evidence to revise earlier segments in a single pass, and the updated nodes predict residual coordinate and confidence corrections. Requiring only proposals, scores, and scene context, FutureLift provides a common refinement interface for structurally different forecasting backbones. On Argoverse2 and the Waymo Open Motion Dataset, it consistently improves frozen proposals and outperforms native and specialized refiners across marginal and joint forecasting. On the WOMD motion-prediction leaderboard, FutureLift ranks first in minADE (0.5049m) and minFDE (0.9942m) among the compared standard-input methods, without LiDAR or ensembling, while achieving a competitive 0.4874 Soft mAP.