Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study develops hybrid models that combine spiking neural networks (SNNs) with convolutional neural networks (CNNs) to effectively detect human falls using synthetic event data generated from smartphone videos. By transforming conventional video frames into event-based data, the approach capitalizes on the energy efficiency and spatio-temporal processing strengths of SNNs. The evaluation shows that these hybrid models achieve notable improvements in efficiency while maintaining accuracy compared to traditional machine learning methods, highlighting their applicability in real-world scenarios.
Hybrid SNN-CNN models can detect falls with greater efficiency than traditional methods, leveraging synthetic event data for enhanced performance.
This work presents the development of hybrid models that integrate spiking neural networks (SNNs) with components of convolutional neural networks (CNNs) to learn from simulated event-based camera data (Dynamic Vision Sensor, DVS) generated from conventional smartphone videos. Aimed primarily at human fall detection, the approach leverages the energy efficiency and spatio-temporal processing capabilities of SNNs by converting video frames into event-based data. The proposed models are evaluated through simulations on multiple datasets, comparing their performance to that of traditional machine learning models. Results demonstrate significant gains in efficiency without sacrificing accuracy, underscoring the potential of combining SNNs and DVS technology for complex tasks in real-world environments.