Search papers, labs, and topics across Lattice.
This paper introduces a patch-based approach to Implicit Neural Representations (INR) that reduces computational costs associated with high-resolution signal modeling by processing non-overlapping pixel patches in a single forward pass. By implementing this method on an FPGA with a configurable pipeline and dual-precision computation, the authors achieve a significant reduction in inference latency by 75% while maintaining comparable reconstruction quality to traditional pixel-level INRs. The results demonstrate that this approach not only enhances efficiency but also remains lightweight in terms of parameter overhead, making it suitable for scalable applications.
Achieving a 75% reduction in inference latency while maintaining high reconstruction quality could revolutionize how we deploy Implicit Neural Representations in real-time applications.
Implicit Neural Representation (INR) provides an effective approach for continuous signal modeling, but classical per-pixel inference results in quadratic growth in inference count, leading to dramatically increased computational costs in high-resolution application scenarios. To address this issue, we propose a patch-based approach that treats non-overlapping patches as fundamental processing units and predicts entire pixel patches in a single forward pass, significantly reducing the number of inference queries required. To validate the effectiveness of our approach, we propose a hardware acceleration architecture on the Field Programmable Gate Array (FPGA) platform for the INR model, which features a configurable pipeline and supports dual-precision computation. Our patch-based INR achieves comparable reconstruction quality to pixel-level INR (34.97 dB PSNR with 2 x 2 patches) while reducing inference latency by 75% with only 0.6% parameter overhead.
