Search papers, labs, and topics across Lattice.
This paper introduces a transformer-based collaborative feature aggregation method for face super-resolution (SR) and robust person re-identification, addressing the common issues of blurring and distortion in low-quality images. By leveraging multiple correlated facial observations across time or viewpoints, the approach unifies identity features, allowing for more accurate facial feature estimation. Experimental results demonstrate significant improvements over state-of-the-art methods in both face SR and re-identification tasks, underscoring the benefits of joint identity reconstruction and progressive image restoration.
Transforming low-quality facial images into high-resolution representations while enhancing re-identification accuracy could redefine standards in facial recognition technology.
We propose a novel collaborative approach for face super-resolution (SR) and robust person re-identification from sequential or multi-view facial images. Traditional SR methods often suffer from blurring and distortion in faces recovered from poor-quality images due to low resolution. Image- and video-based facial SR methods using facial landmarks or segmentation also have similar challenges. To overcome these limitations, we leverage multiple correlated facial observations, across time or viewpoints, by introducing a transformer-based collaborative feature aggregation method that unifies identity features from multi-sequence or multi-view data. This allows faces in multiple sequences of an individual to contribute to accurately estimating common facial features. Furthermore, we propose a cascade SR network to progressively restore the high-resolution image of the target鈥檚 face with gradual facial feature unification. The unified identity representation is further utilized in person re-identification scenarios, enabling accurate matching even under severe image degradation. The exhaustive experimental results and comparisons show that our method outperforms other state-of-the-art methods, demonstrating consistent improvements in both face super-resolution and re-identification performance. Our work highlights the effectiveness of joint identity reconstruction and progressive image restoration from multiple facial inputs in enhancing downstream visual recognition tasks.
