Search papers, labs, and topics across Lattice.
This paper tackles collaborative perception with heterogeneous agents, where new agents with unseen sensor configurations can appear after deployment. They propose ALF, a framework that lifts lightweight box-level messages into ego-compatible auxiliary features using pseudo-BEV maps and object-centric cues. Results on V2X-Real show ALF outperforms prior work by 35.91% in relative mAP@0.7 under zero-shot evaluation, while maintaining low bandwidth requirements (9.6 Kbps).
Achieve 35% better object detection in collaborative perception without any adaptation to new, unseen sensor configurations, using a surprisingly lightweight communication scheme.
Collaborative perception improves 3D object detection by enabling agents to share complementary observations, but most existing methods assume fixed or known collaborator encoder configurations, limiting deployment in practice. In this work, we consider an open-world setting in which auxiliary agents with unseen configurations may appear after deployment, such as different LiDAR beam counts or encoder architectures. To address this challenge, we propose ALF, a collaborative perception framework that enables zero-adaptation collaboration with unseen agent configurations by lifting lightweight box-level messages into ego-compatible auxiliary features. ALF converts auxiliary box-level messages into pseudo-BEV maps and synthesizes ego-compatible latent features by combining object-centric cues with scene context from the ego feature. On V2X-Real, under a zero-shot evaluation across 64 case studies, ALF outperforms the strongest prior baseline by 35.91% in relative mAP@0.7 while requiring only 120 bytes per agent per frame (approximately 9.6 Kbps bandwidth at 10 Hz).