Search papers, labs, and topics across Lattice.
This paper addresses the challenge of domain generalizable (DG) person re-identification (Re-ID) by enhancing the inference stage through MLLM-empowered re-ranking. By adapting a Multimodal Large Language Model (MLLM) to Re-ID data, the authors introduce a novel distance metric that improves the reliability of feature distances in unseen domains. Extensive experiments show that this approach significantly boosts re-ranking performance across various DG Re-ID benchmarks, demonstrating its model-agnostic applicability and effectiveness.
MLLM-empowered re-ranking can dramatically enhance person re-identification accuracy in unseen domains, overcoming traditional encoder limitations.
Domain Generalizable (DG) person re-identification (Re-ID) has attracted growing research interest due to its potential for deployment in unseen real-world scenarios. Most existing approaches address DG Re-ID by focusing on training domain-generalizable encoders but ignore the possible refinements in inference stage. In contrast, this work explores an alternative direction which improves inference re-ranking to enhance DG Re-ID. Conventional re-ranking methods typically rely on neighborhood-based distances to refine the initial ranking list, inherently depending on features produced by the Re-ID encoder. However, they deteriorate on target domains since the encoder lacks sufficient generalizability to produce reliable feature distances on unseen scenarios. Inspired by the remarkable generalization capabilities of recent Multimodal Large Language Models (MLLMs), we propose an MLLM-empowered distance metric to improve re-ranking in DG Re-ID. Specifically, we first adapt an MLLM to Re-ID data through supervised fine-tuning, which incorporates a domain-agnostic prompt and a query-candidate hard mining scheme. Then, the adapted MLLM is employed to compute a $渭$-distance during inference, which is robust to domain gap and significantly enhances subsequent re-ranking performance. Our approach is model-agnostic and can be seamlessly integrated into previous re-ranking frameworks. Extensive experiments demonstrate that our approach consistently yields substantial performance improvements across multiple DG Re-ID benchmarks. The code of this work will be released at https://github.com/RikoLi/MUSE soon.
