Search papers, labs, and topics across Lattice.
This study introduces a novel framework for diagnosing depression severity through the analysis of facial videos using Deep Convolutional Neural Networks (DCNNs). By fine-tuning these networks on the AVEC depression dataset, the authors enhance model interpretability through saliency maps that highlight relevant facial regions and temporal expressions. The approach not only improves predictive performance over existing benchmarks but also provides visual and quantitative explanations for the model's decisions, bridging a critical gap in automated depression diagnosis.
Enhanced interpretability in depression diagnosis models reveals how facial expressions inform predictions, paving the way for more effective mental health interventions.
Given the widespread prevalence of depression and its consequential impact on individuals and society, it is crucial to obtain objective measures for early diagnosis and intervention. As a multidisciplinary topic, these objective measures should be interpretable and accessible to health care professionals, ensuring effective collaboration and treatment planning in the realm of mental health care. Even though current automated depression diagnosis approaches improved over the last decade, a critical gap exists as they often lack affect-specificity and interpretability, limiting their practical application and potential impact on mental health care. In particular, interpretability from temporal activities from videos when deep models are used is not fully explored. In this study, we present a novel framework for analyzing Deep Neural Networks' decisions when trained on facial videos, specifically focusing on automatic depression severity diagnosis. By fine-tuning Deep Convolutional Neural Networks (DCNN) pre-trained on Action Recognition datasets on depression severity facial videos from AVEC depression dataset, our framework is able to interpret the model's saliency maps by examining face regions and temporal expression semantics. Our approach generates both visual and quantitative explanations for the model's decisions, providing greater insight into its reasoning. In addition to this interpretability, our video-based modeling has improved upon previous single-face benchmarks for visual depression diagnosis, resulting in enhanced predictive performance. Overall, our work demonstrates the successful development of a framework capable of generating hypotheses from a facial model's decisions while simultaneously improving depression's predictive capabilities.
