Search papers, labs, and topics across Lattice.
This paper investigates the end-to-end optimization of phase masks for incoherent imaging in object classification tasks, comparing performance against conventional lens-based systems. The authors establish that significant performance gains from optimized optics occur primarily under constrained detector readout conditions, while full readout limits the advantages of incoherent phase masks. The findings reveal that optimized optics can enhance classification accuracy by improving class separability, especially in low-noise environments and when class-discriminative features are concentrated at lower spatial frequencies.
Optimized phase masks can dramatically boost classification performance under limited detector readout, but their benefits vanish with full readout conditions.
End-to-end co-optimization of optical front-ends (e.g. metasurfaces) and neural network back-ends has been widely applied to imaging tasks, yet a formalism characterizing when and why such systems outperform conventional lens-based imaging is largely lacking. This paper focuses on object classification, a central imaging task, and asks when end-to-end optimization of a phase mask for incoherent imaging improves performance over a conventional focusing lens. We find that these gains arise primarily under constrained detector readout and are limited under full detector readout. In the latter setting, we prove that no incoherent phase mask exceeds the ideal-channel mutual information between detector measurements and class labels; a conventional focusing lens approaches this ceiling, and joint optimization yields no empirical gain. When detector readout is constrained -- by coarse spatial sampling or a limited number of measurements -- optimized optics can substantially improve classification by increasing class separability in the detector measurements. These gains are largest under low detector noise and shrink as noise grows, because the optics shape the signal before it reaches the detector but cannot remove noise added afterward. The advantage also depends on the spectral structure of the task: co-design helps most when class-discriminative content is concentrated at lower spatial frequencies than within-class variation. We develop a theoretical framework formalizing these distinctions and test its predictions on synthetic data and standard benchmarks (MNIST, FashionMNIST, SVHN).
