Search papers, labs, and topics across Lattice.
This paper introduces VR3D, a novel framework for aerial-ground person re-identification that addresses the challenges posed by viewpoint variations and occlusions by mapping images into a unified 3D coordinate space. By employing View-Robust 3D Representation Interaction and 3D Geometry-Semantic Attention, the method effectively grounds 2D features in a 3D context, allowing for robust feature interaction across different viewpoints. Extensive experiments on benchmark datasets show that VR3D significantly improves performance, achieving a 5.63% increase in Rank-1 accuracy on the CARGO dataset compared to existing methods.
VR3D achieves a breakthrough in aerial-ground person re-identification by leveraging 3D geometry to eliminate viewpoint bias, resulting in a 5.63% accuracy boost on challenging datasets.
Aerial-ground person re-identification is a challenging task due to cross-platform viewpoint variations, which cause severe occlusion and geometric deformation. Existing methods attempt to learn view-invariant representations exclusively within the 2D image space, where drastic viewpoint variations cause the learned features to remain coupled with viewpoint bias. To address this, we propose VR3D, a View-Robust 3D Representation Learning framework that maps images into a unified 3D coordinate space to achieve view-independent feature interaction. Specifically, we introduce View-Robust 3D Representation Interaction, which leverages 3D priors extracted from single 2D observations to lift 2D appearance features into a canonical 3D space. VR3I employs 3D Geometry-Semantic Attention to establish interactions between 2D patches and 3D voxels from corresponding body parts based on their 3D spatial locations, effectively grounding 2D semantics within a 3D framework. In addition, as the reliability of these representations varies across samples due to viewpoint changes and 3D reconstruction errors, we introduce Reliability-Aware Fusion, which estimates sample-specific reliability and adaptively aggregates the multi-source representations. Extensive experiments on three benchmark datasets (CARGO, AG-ReID.v1, and AG-ReID.v2) demonstrate that VR3D outperforms recent methods. For example, it achieves a 5.63% improvement in Rank-1 on CARGO. Our code will be released.
