Search papers, labs, and topics across Lattice.
This paper addresses the challenge of text-based person retrieval by introducing a novel framework that accommodates varying levels of query granularity. It formalizes a five-level granularity spectrum and introduces the UFine6926-MG dataset, which is annotated for comprehensive multi-grained retrieval. The proposed Cross-modal Multi-grained Aligning and Matching (CMAM) framework outperforms existing methods by effectively managing query uncertainty and enhancing feature learning through granularity-aware techniques.
CMAM revolutionizes text-based person retrieval by achieving granularity-aware matching that significantly outperforms state-of-the-art methods across diverse query levels.
Text-based person retrieval faces a critical but under-explored challenge: the inherent uncertainty of query granularity in real-world scenarios. This paper introduces a new paradigm, Text-based Person Retrieval with Any Granularity, and provides a systematic solution. First, we formalize a five-level granularity spectrum and construct UFine6926-MG, a high-quality multi-grained dataset annotated comprehensively at all granularities via a novel Multi-grained Text Annotation Engine. Second, acknowledging that coarse queries naturally correspond to multiple valid candidates, we propose MG-Eval, a holistic evaluation benchmark with progressively detailed texts and cross-identity labels that reflect real-world semantics, alongside tailored evaluation metrics and protocols. Third, after a comprehensive diagnosis reveals the systemic limitations of existing research, we propose the Cross-modal Multi-grained Aligning and Matching (CMAM) framework. CMAM achieves granularity-aware retrieval through: 1) orthogonal-expert perception to disentangle granularity-specific features; 2) probabilistic alignment to model many-to-many matches under query uncertainty; and 3) granularity-consistent reasoning to steer feature learning via joint cross-modal granularity verification. Experiments demonstrate that CMAM significantly outperforms state-of-the-art methods across all granularity levels. This work establishes a foundational benchmark and a robust baseline, paving the way for more practical person retrieval systems.
