Search papers, labs, and topics across Lattice.
This study introduces a one-stage YOLOv11m-based model specifically designed for detecting infant faces in challenging neonatal clinical environments, addressing the significant obstacles posed by cluttered backgrounds and poor lighting. By training on a combination of publicly available datasets and fine-tuning on a specialized neonatal dataset of 228 videos, the model achieved an impressive AP50 score of 0.96, demonstrating a marked improvement over existing general face detectors. The findings underscore the potential for enhanced non-contact assessments in clinical settings, which are critical for monitoring infant health and distress.
Achieving a 0.96 AP50 score, this model significantly outperforms existing face detection systems in the complex neonatal environment, paving the way for advanced non-contact assessments.
Reliable localisation of the neonatal face is the first step for several video-camera based non-contact assessments such as pain and distress related facial expression analysis, pain scoring, cardiorespiratory signal extraction and cessation of breathing alerts. However, major challenges persist in neonatal clinical environments. Cluttered backgrounds, illumination changes and poor lighting conditions can reduce the accuracy of face detection models. Clinical interventions, monitoring equipment and, in some cases, medical devices can obstruct the face, making visual assessment difficult. We propose a one-stage YOLOv11m-based model tailored for face detection of infants in neonatal clinical environments. We combined multiple publicly available datasets (VGGFace2, CelebA, FDDB, WIDER FACE) to train and evaluate our proposed model. We then fine-tuned our model on a neonatal research dataset involving 228 videos from 114 recording sessions of 113 independent infants. Before fine-tuning, our model achieved an AP50 of 0.87, surpassing the performance of three state-of-the-art general face detectors. Performance improved further to an AP50 of 0.96 after clinical-domain adaptation. Evaluating face detection performance across different datasets remains a challenge due to the lack of publicly available neonatal datasets. Prioritising the creation of such datasets, while upholding appropriate privacy safeguards and ethical standards in their creation and use, would greatly support further progress in this field.
