Search papers, labs, and topics across Lattice.
This paper introduces a generative framework for restoring missing views in light-field camera arrays by leveraging information from neighboring cameras. By employing a conditional Generative Adversarial Network (cGAN) with a positional encoding map, the method generates geometrically consistent reconstructions of absent views. Experimental results on both synthetic and real-world datasets show significant improvements in visual plausibility and photometric accuracy over existing interpolation methods.
Missing views in light-field imaging can be restored with surprising accuracy by harnessing the power of neighboring cameras through a novel generative approach.
In light-field (LF) imaging systems, dense spatial sampling from a camera array enables powerful post-capture capabilities such as refocusing and depth estimation. However, real-world LF capture is often affected by hardware malfunctions, where one or more cameras in the array fail, leading to missing sub-aperture images and degraded reconstruction quality. This paper addresses the problem of defective or missing view restoration in light-field camera arrays. We propose a novel generative framework that synthesizes the absent views by exploiting information from a carefully selected subset of neighboring cameras. These selected images, along with a positional encoding map indicating both their locations and the desired target view, are fed into a conditional Generative Adversarial Network (cGAN) trained to generate the missing viewpoint in a geometrically consistent manner. Extensive experiments on synthetic and real-world LF datasets demonstrate that our method produces visually plausible and photometrically accurate reconstructions, outperforming baselines for view interpolation both quantitatively and qualitatively. The proposed framework thus offers a robust and efficient solution for fault-tolerant light-field image acquisition.