Search papers, labs, and topics across Lattice.
This paper introduces the Celeb Twins Test Set (CTTS), a unique dataset designed to evaluate face recognition systems specifically for monozygotic twins, featuring metadata on distinguishing skin marks and mirror asymmetry. Despite achieving over 76% accuracy with current deep CNN matchers, the study reveals that these models largely overlook critical features such as skin marks and asymmetry that could enhance recognition performance. The authors also explore the potential of generative AI tools to augment training datasets by creating synthetic images of imagined twins, addressing the representation gap in existing face recognition systems.
Current face recognition models miss key features in twin identification, achieving only 76% accuracy despite the potential for significant improvement through skin marks and asymmetry.
Past literature on face recognition for monozygotic (("identical") twins points to facial marks and mirror asymmetry as possible directions for improved accuracy of twins recognition. The Celeb Twins Test Set (CTTS) contains web-scraped image pairs for 80 sets of celebrity twins. It is the only twins test set with meta-data for twins with distinguishing skin marks and possible mirror asymmetry. CTTS is organized in the manner of face verification test sets such as LFW, CALFW, CPLFW, CFP-FP, and AgeDB-30. Current deep CNN matchers can achieve over 76% accuracy in classifying CTTS same-person / different-person image pairs. We show that current matchers do not make use of skin marks, or asymmetry, and discuss reasons for this. Finally, we discuss the feasibility of using generative AI tools such as Grok, ChatGPT and Gemini to create images of imagined monozygotic twins as a means to increase representation of twins in face recognition training sets.
