Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study introduces ExpSpeech-Net, a lightweight deepfake detection model that effectively fuses facial expression and speech analysis using SqueezeNet and RNN architectures. By leveraging advanced feature extraction techniques and a smart feature-selection strategy via the Sandpiper-Assisted Slime Mould Algorithm (SASMA), the model achieves impressive performance metrics, including 94.5% accuracy and 99.3% precision. The findings highlight the potential for practical, real-time deepfake detection systems that can be deployed in everyday applications, addressing the growing challenge of deepfake credibility in online content.
Achieving 94.5% accuracy in deepfake detection, ExpSpeech-Net shows that multimodal analysis can outperform traditional methods while remaining lightweight and efficient.
Deepfake videos are increasingly challenging the credibility of online content. Many existing detection methodology relies on complex, resource-intensive models, which limit their practical use. The study introduces the ExpSpeech-Net deepfake detection (SqN-R-DFD) model, which utilizes SqueezeNet and RNN (Recurrent Neural Network) as its backbone, providing a lightweight and efficient deepfake detection framework that simultaneously analyzes facial expressions and speech patterns. The approach incorporates advanced feature extraction, such as ISLBT-based features for image and MPNCC for signals, along with a smart feature-selection strategy using SASMA (Sandpiper-Assisted Slime Mould Algorithm), ensuring optimal and balanced input to the detection models. By combining SqueezeNet and an RNN, subtle inconsistencies in deepfake videos are captured effectively. The framework achieves 94.5% accuracy, precision of 99.3%, and F-measure of 96.8%, outperforming conventional methods. This demonstrates that integrating multiple modalities with intelligent preprocessing and feature selection enables practical, real-time deepfake detection suitable for everyday applications.