Search papers, labs, and topics across Lattice.
The paper introduces AttriBE, a framework to quantify attribute expressivity in person re-identification (ReID) embeddings by measuring the mutual information between learned features and attributes using a secondary neural network. Applying AttriBE to transformer-based ReID models, the authors find that BMI consistently exhibits the highest expressivity in deeper layers of visible-spectrum ReID, while pitch becomes more prominent in cross-spectral ReID. These findings reveal a hierarchy of implicitly encoded attributes in ReID embeddings and their dependence on spectral modality.
ReID models implicitly encode a hierarchy of attributes like BMI and pose, revealing potential biases and vulnerabilities that vary across spectral modalities.
Person re-identification (ReID) systems that match individuals across images or video frames are essential in many real-world applications. However, existing methods are often influenced by attributes such as gender, pose, and body mass index (BMI), which vary in unconstrained settings and raise concerns related to fairness and generalization. To address this, we extend the notion of expressivity, defined as the mutual information between learned features and specific attributes, using a secondary neural network to quantify how strongly attributes are encoded. Applying this framework to three transformer-based ReID models on a large-scale visible-spectrum dataset, we find that BMI consistently shows the highest expressivity in deeper layers. Attributes in the final representation are ranked as BMI > Pitch > Gender > Yaw, and expressivity evolves across layers and training epochs, with pose peaking in intermediate layers and BMI strengthening with depth. We further extend the analysis to cross-spectral person identification across infrared modalities including short-wave, medium-wave, and long-wave infrared. In this setting, pitch becomes comparable to BMI and attribute trends increase monotonically across depth, suggesting increased reliance on structural cues when bridging modality gaps. Overall, the results show that transformer-based ReID embeddings encode a hierarchy of implicit attributes, with morphometric information persistently embedded and pose contributing more strongly under cross-spectral conditions.
