Search papers, labs, and topics across Lattice.
This paper establishes a foundational framework for kinship verification (KV) from voice by proposing a novel evaluation protocol that mitigates confounding factors and employs a family-disjoint train-test split. The authors reveal that genealogical similarity influences KV and speaker verification in opposing ways, and they evaluate three neural speaker embedding extractors, with ReDimNet achieving a zero-shot equal error rate (EER) of 20.8%. The findings underscore the challenges of KV while demonstrating that speaker embeddings can capture familial cues, paving the way for future voice-based kinship analysis.
Speaker embeddings reveal familial cues, but kinship verification proves significantly more challenging than speaker verification, with EERs highlighting the complexity of the task.
Kinship verification (KV) from voice, the task of determining whether two speakers are biologically related, has received only little attention. Our work establishes a foundational basis for this emerging frontier, contributing to both performance evaluation and detection methodologies. First, leveraging the speech recordings of the large-scale audio-visual dataset, KAN-AV, we propose a revised evaluation protocol that controls for various confounders and adopts a family-disjoint train--test split to address open-set KV. Second, we analyze the close connection between speaker verification and KV, showing that genealogical similarity of speaker pairs plays opposite roles in the two tasks. Third, we tackle KV using three neural speaker embedding extractors (ECAPA-TDNN, WavLM-ECAPA, and ReDimNet) combined with various back-ends. In zero-shot KV including same-speaker target trials, ReDimNet achieves the lowest equal error rate (EER) of $20.8\%$; however, performance degrades to $39.7\%$ under strict kin trials, where same-speaker target trials are excluded. Our best trainable back-end, which applies asymmetric processing of the embedding pair to mitigate age-difference effects, obtains an EER of $32.0\%$ ($18.6\%$ with speaker target trials included). These results highlight the difficulty of KV while showing that speaker embeddings encode familial cues, offering a promising foundation for voice-based kinship analysis.