Search papers, labs, and topics across Lattice.
This paper introduces the Air-Ground Progressive Collaboration (AGPC) benchmark and the Socialized Co-Perception (SCP) framework to enhance air-ground collaborative perception by addressing the challenges of functional dependencies and discrepancies in aerial and ground views. By modeling collaboration as a progressive cross-task collaboration task, the authors demonstrate that task-conditioned collaboration significantly outperforms traditional single-task cross-view fusion methods. The proposed SCP framework achieves a 3.73% coevolutionary gain and a 7.86% improvement in average downstream performance, underscoring the importance of structured collaboration in heterogeneous environments.
Task-conditioned collaboration outperforms traditional fusion methods, yielding significant performance gains in air-ground perception tasks.
Air-ground collaborative perception is crucial for robust visual understanding in real-world dynamic environments. However, existing studies typically formulate collaboration as single-task cross-view fusion, overlooking the functional dependencies among localization, target association, and fine-grained parsing. In addition, the heterogeneous nature of aerial and ground views introduces substantial geometric, scale, and occlusion discrepancies, making uniform feature sharing vulnerable to negative transfer. To tackle these issues, we model air-ground perception as a progressive cross-task collaboration task and construct the Air-Ground Progressive Collaboration (AGPC) benchmark, a spatio-temporally aligned benchmark comprising more than 745K raw video frames. Built upon this benchmark, we propose Socialized Co-Perception (SCP), a coarse-to-fine framework that organizes collaboration progressively from aerial global localization to ground target association and identity-aware parsing. Its core module, the Dual-Layer Router (DLR), decouples input-side multi-scale expert selection from output-side task-conditioned modulation, enabling selective cross-view and cross-task interaction while suppressing harmful interference. Extensive experiments demonstrate the effectiveness of SCP. It achieves a 3.73\% coevolutionary gain and a 7.86\% improvement in average downstream performance. These results show that task-conditioned collaboration is more effective than uniform fusion for heterogeneous air-ground perception. The code is available at https://github.com/g1136639260-spec/AGSCP.
