Search papers, labs, and topics across Lattice.
This study quantifies the geometric differences in cluster properties between training and non-training identities in face recognition models, revealing that the number of training identities significantly impacts member/non-member separability. By analyzing 180 models across various configurations, the researchers find that while backbone size and loss head have minimal influence, the geometric membership signal diminishes as more identities are introduced. Additionally, they demonstrate that cross-domain benchmarks can artificially inflate the perceived membership signal, and a learned classifier can extract further membership insights from the combined statistics.
The number of training identities drastically alters the geometric separability of face recognition models, with surprising implications for model evaluation across different domains.
Face recognition models represent each face as an embedding vector on the unit hypersphere by clustering embeddings of the same identity while pushing different identities apart through angular-margin losses. Because these losses act only on training identities, non-member identities may form clusters with different geometric properties. In this paper, we quantify the magnitude of this difference and what training-time factors control it. We compute four statistics based on cluster geometry across 180 face recognition models in a factorial design over IResNet backbone size, loss head, training duration, and the number of training identities, and evaluate each configuration on nine benchmarks. Our results indicate that the number of training identities has the largest effect on member/non-member separability, while backbone and loss head contribute far less, and that, on a same-domain held-out reference, the geometric membership signal decreases monotonically as more identities are added to training. We provide an analysis of cross-domain (pose, age, quality, ethnicity) non-member benchmarks and report that these inflate the apparent membership signal. Finally, we fuse all four statistics with a learned classifier to reveal additional membership information beyond the best individual statistic.