Search papers, labs, and topics across Lattice.
AceleradorSNN, a novel cognitive system, integrates spiking neural networks (SNNs) for processing asynchronous data from dynamic vision sensors (DVS) with a reconfigurable image signal processor (ISP) for RGB cameras. The system is implemented on an FPGA and utilizes surrogate-gradient training for the SNN backbones. Results demonstrate a hardware-oriented design capable of high-speed, low-latency object detection, addressing limitations of CNNs in autonomous systems.
Achieve high-speed, low-latency object detection in autonomous systems by integrating spiking neural networks and dynamic image signal processing on an FPGA.
The demand for high-speed, low-latency, and energy-efficient object detection in autonomous systems -- such as advanced driver-assistance systems (ADAS), unmanned aerial vehicles (UAVs), and Industry 4.0 robotics -- has exposed the limitations of traditional Convolutional Neural Networks (CNNs). To address these challenges, we have developed AceleradorSNN, a third-generation artificial intelligence cognitive system. This architecture integrates a Neuromorphic Processing Unit (NPU) based on Spiking Neural Networks (SNNs) to process asynchronous data from Dynamic Vision Sensors (DVS), alongside a dynamically reconfigurable Cognitive Image Signal Processor (ISP) for RGB cameras. This paper details the hardware-oriented design of both IP cores, the evaluation of surrogate-gradienttrained SNN backbones, and the real-time streaming ISP architecture implemented on Field-Programmable Gate Arrays (FPGA).
