Search papers, labs, and topics across Lattice.
Lens2Zernike, a novel deep learning framework, is introduced to blindly recover physical optical parameters (Zernike coefficients) from single blurred mobile phone images. The framework uniquely integrates supervision across three optical domains: direct Zernike coefficient regression, differentiable physics constraints for wavefront and PSF derivation, and auxiliary spatial map predictions. Experiments show a 35% improvement over coefficient-only baselines and outperforms existing deep learning deblurring methods, enabling stable non-blind deconvolution and improved image restoration.
Unlike black-box deblurring methods, Lens2Zernike leverages physics-consistent deep learning to directly recover interpretable optical parameters from blurred images, leading to more robust and accurate image restoration.
Mobile photography is often limited by complex, lens-specific optical aberrations. While recent deep learning methods approach this as an end-to-end deblurring task, these"black-box"models lack explicit optical modeling and can hallucinate details. Conversely, classical blind deconvolution remains highly unstable. To bridge this gap, we present Lens2Zernike, a deep learning framework that blindly recovers physical optical parameters from a single blurred image. To the best of our knowledge, no prior work has simultaneously integrated supervision across three distinct optical domains. We introduce a novel physics-consistent strategy that explicitly minimizes errors via direct Zernike coefficient regression (z), differentiable physics constraints encompassing both wavefront and point spread function derivations (p), and auxiliary multi-task spatial map predictions (m). Through an ablation study on a ResNet-18 backbone, we demonstrate that our full multi-task framework (z+p+m) yields a 35% improvement over coefficient-only baselines. Crucially, comparative analysis reveals that our approach outperforms two established deep learning methods from previous literature, achieving significantly lower regression errors. Ultimately, we demonstrate that these recovered physical parameters enable stable non-blind deconvolution, providing substantial in-domain improvement on the patented Institute for Digital Molecular Analytics and Science (IDMxS) Mobile Camera Lens Database for restoring diffraction-limited details from severely aberrated mobile captures.
