Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Collaborative Joint Perception and Prediction (Co-P&P), a framework that integrates Collaborative Perception (CP) with motion prediction to address challenges like perception errors and visual occlusions in Connected Autonomous Vehicles (CAVs). The authors evaluate various fusion strategies and find that prediction-level fusion underperforms compared to detection-level or tracking-level fusion. Their end-to-end Co-P&P prototype demonstrates that collaborative point-cloud sharing significantly enhances forecasting accuracy while achieving a 34x reduction in communication bandwidth through neural compression.
Prediction-level fusion in CAVs may actually degrade performance, challenging assumptions about collaborative sensor integration.
Connected Autonomous Vehicles (CAVs) increasingly exploit Vehicle-to-Everything (V2X) communication to exchange multi-source sensor information, enabling advanced Collaborative Perception (CP) capabilities. Extending beyond these capabilities, this work focuses on Collaborative Joint Perception and Prediction (Co-P&P), a paradigm that unifies CP with motion prediction to mitigate two persistent challenges: the accumulation of perception errors and visual occlusions. We present a conceptual framework for Collaborative Joint Perception and Prediction (Co-P&P) that improves motion prediction of surrounding road users, thereby enhancing situational awareness in complex and dynamic traffic environments. Building upon our preliminary study, this extended version compares the performance of different fusion strategies and establishes baseline performance for a modular design of perception and prediction. Experimental results show that prediction-level fusion leads to a decline in overall system performance compared to detection-level or tracking-level fusion. We further implement a minimal end-to-end Co-P&P prototype that couples collaborative point-cloud sharing via the RENO neural codec with joint detection-forecasting via FutureDet, showing that collaboration improves forecasting accuracy while neural compression preserves this benefit at roughly 34x lower communication bandwidth.