Search papers, labs, and topics across Lattice.
SpiderCam, a novel FPGA-based camera, achieves real-time (32.5 FPS) sparse depth map generation (480x400) using depth from differential defocus (DfDD) with a power consumption of only 624 mW. The system employs a custom dual-image camera and a SystemVerilog implementation of DfDD, optimized for low-power sensors and limited memory capacity. Algorithmic improvements to DfDD and a memory-local streaming architecture enable this sub-Watt performance, setting a new benchmark for passive FPGA-based 3D cameras.
SpiderCam shatters power consumption barriers for FPGA-based 3D cameras, achieving sub-Watt operation while maintaining real-time performance.
We introduce SpiderCam, an FPGA-based snapshot depth-from-defocus camera which produces 480x400 sparse depth maps in real-time at 32.5 FPS over a working range of 52 cm while consuming 624 mW of power in total. SpiderCam comprises a custom camera that simultaneously captures two differently focused images of the same scene, processed with a SystemVerilog implementation of depth from differential defocus (DfDD) on a low-power FPGA. To achieve state-of-the-art power consumption, we present algorithmic improvements to DfDD that overcome challenges caused by low-power sensors, and design a memory-local implementation for streaming depth computation on a device that is too small to store even a single image pair. We report the first sub-Watt total power measurement for passive FPGA-based 3D cameras in the literature.
