Search papers, labs, and topics across Lattice.
This paper introduces the Integrated Forward-Inverse Network (IFIN), a novel architecture designed for lensless image reconstruction that combines differentiable forward projections with learnable inverse updates at multiple scales. By maintaining data fidelity throughout the network hierarchy and adapting point-spread function (PSF) kernels under model uncertainty, IFIN effectively addresses the challenges posed by multiplexed observations and calibration errors. The method achieves state-of-the-art reconstruction quality on benchmark datasets, demonstrating its potential applicability in other imaging contexts such as Gaussian deblurring and holography.
Achieving state-of-the-art lensless image reconstruction, IFIN leverages a unique bidirectional coupling of forward and inverse processes to enhance data fidelity and adaptability.
Lensless imaging enables compact and versatile computational cameras by replacing bulky optics with thin coded elements. However, reconstruction from the resulting measurements is challenging: large-footprint point-spread functions (PSFs) produce highly multiplexed observations, making inversion severely ill-conditioned and sensitive to calibration errors and model mismatch. While deep learning approaches, including hybrid models that incorporate physics priors, have shown promise, explicitly maintaining data fidelity throughout the network hierarchy remains difficult. Here, we propose the Integrated Forward-Inverse Network (IFIN), a physics-guided architecture that interleaves differentiable forward projections with learnable inverse updates at every scale, enabling complementary cues to be exploited jointly in the measurement and image domains. This bidirectional coupling supports progressive, physics-consistent refinement and permits system-constrained PSF kernel adaptation under model uncertainty. On challenging lensless benchmarks, including a newly introduced dataset, IFIN achieves state-of-the-art reconstruction quality. We further observe competitive performance on Gaussian deblurring and simulated inline holography reconstruction, suggesting that the same interleaving principle can extend beyond lensless cameras.
