Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study introduces StyleID, a novel dataset and evaluation framework designed to enhance facial identity recognition across diverse artistic styles. By incorporating human perception into the training process, the authors fine-tune existing identity encoders to improve their performance in recognizing faces rendered in stylized formats, addressing the brittleness of traditional models. The results show that the calibrated models achieve significantly higher correlation with human judgments and demonstrate improved robustness when applied to out-of-domain, artist-drawn portraits.
Identity encoders can now achieve human-level performance in recognizing stylized faces, bridging the gap between artistic expression and identity consistency.
Creative face stylization aims to render portraits in diverse visual idioms such as cartoons, sketches, and paintings while retaining recognizable identity. However, current identity encoders, which are typically trained and calibrated on natural photographs, exhibit severe brittleness under stylization. They often mistake changes in texture or color palette for identity drift or fail to detect geometric exaggerations. This reveals the lack of a style-agnostic framework to evaluate and supervise identity consistency across varying styles and strengths. To address this gap, we introduce StyleID, a human perception-aware dataset and evaluation framework for facial identity under stylization. StyleID comprises two datasets: (i) StyleBench-H, a benchmark that captures human same-different verification judgments across diffusion- and flow-matching-based stylization at multiple style strengths, and (ii) StyleBench-S, a supervision set derived from psychometric recognition-strength curves obtained through controlled two-alternative forced-choice (2AFC) experiments. Leveraging StyleBench-S, we fine-tune existing semantic encoders to align their similarity orderings with human perception across styles and strengths. Experiments demonstrate that our calibrated models yield significantly higher correlation with human judgments and enhanced robustness for out-of-domain, artist drawn portraits. All of our datasets, code, and pretrained models are publicly available at https://kwanyun.github.io/StyleID_page/