Search papers, labs, and topics across Lattice.
This study fine-tunes six self-supervised models on a multilingual dataset to enhance the detection of child-directed speech from long-form recordings, revealing that in-domain pre-training on child-centered data significantly outperforms models trained solely on adult speech. By incorporating surrounding context, the researchers achieved a notable 13.8% improvement in average F1-score for classification tasks. Additionally, the model was tested in a realistic end-to-end pipeline, demonstrating robust performance despite challenges in automatic segmentation compared to a rule-based baseline.
In-domain pre-training on child-centered recordings boosts child-directed speech detection accuracy by over 13%, transforming how we analyze children's language environments.
Automatically distinguishing child-directed speech from adult-directed speech in long-form recordings is key to scalable analyses of children's language environments. Existing approaches process utterances in isolation and have been evaluated primarily on English. We address these gaps along three dimensions. First, we fine-tune and evaluate six-self supervised models on a multilingual dataset of 182 children, showing that in-domain pre-training on child-centered recordings substantially outperforms models trained on adult speech. Second, we demonstrate that incorporating surrounding context substantially improves classification, with an absolute gain of 13.8% in average F1-score. Third, we evaluate our model in a realistic end-to-end pipeline, from adult speech detection to addressee classification, showing that performance drops under automatic segmentation but still consistently outperforms a rule-based baseline.