Search papers, labs, and topics across Lattice.
This study evaluates six self-supervised pretext tasks for infant cry analysis using a consistent encoder and pretraining dataset, revealing that reconstructive objectives excel in cry detection, achieving a 0.988 AUC despite no prior exposure to cries. However, when assessing cry-reason classification on the Donateacry benchmark, all models performed at chance levels, indicating that the limitations lie in the dataset labels rather than model capacity. By altering the evaluation protocol, the authors achieved a significant increase in accuracy, demonstrating that the effective sample size is dictated by the number of infants rather than the model's complexity.
Despite advanced models, cry-reason classification struggles due to label limitations, not capacity, revealing critical insights into dataset quality.
We compare six self-supervised pretext tasks for infant cry analysis under a fixed budget, meaning the same compact encoder of 1.17M parameters, the same 115 hours of license-verified public pretraining audio, and the same evaluation protocol for every candidate. On cry detection the reconstructive objectives dominate, and a linear probe over a masked-spectrogram encoder reaches 0.988 AUC with subject-wise splits even though the encoder never observed a cry during pretraining. On cry-reason classification over donateacry, the de facto public benchmark for cry reasons, every encoder performs at chance (0.38 to 0.54 macro AUC over 5 classes), and neither domain adaptation on 1.8 hours of real cries nor end-to-end fine-tuning moves the result. Since a frozen HuBERT-base with 80 times more parameters shows the same pattern, the bottleneck must sit in the labels and not in model capacity. We then reproduce the 90\%+ accuracies of the donateacry literature on our own system by changing nothing but the evaluation protocol: clip-wise splits raise accuracy to 85.2% (barely above the 83.8% majority-class baseline), and applying augmentation before splitting raises it to 97.9%, matching the reported state of the art, from the same model that measures 0.49 macro AUC under subject-wise splits. Under leakage-free splits, a twentyfold augmentation of the labeled set (vocoder speaker perturbation and noise mixing, 21 hours) leaves cross-subject AUC unchanged: for this task the effective sample size is the number of infants. We release code, seeds and per-clip license manifests.
