Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a method for acquiring and estimating sub-surface scattering properties using a U-Net CNN trained on data captured via a stereo projector-camera setup with phase-shifted profilometry patterns. By reconstructing dense pixel footprints from 3D scanned objects, the approach enables high-fidelity relighting with arbitrary projector patterns, achieving results that closely match real-world illuminated images. The model's ability to generalize across multiple views and objects allows it to effectively handle unseen sub-surface scattering materials, showcasing its robustness and versatility.
Achieving near-perfect reconstruction of sub-surface scattering properties could revolutionize the realism in computer graphics and visual effects.
We present a method to acquire and estimate the sub-surface scattering properties of light transport at a highly detailed level by learning the pixel footprint response at each point on the object surface. The reconstruction leverages 3D scanning techniques as input to a U-Net CNN. A stereo projector-camera setup using phase-shifted profilometry (PSP) patterns efficiently captures the data for a variety of scattering objects. Reconstructing dense pixel footprints allows for relighting with arbitrary high-resolution projector patterns. The final output is a relit color image. Qualitative and quantitative comparison against illuminated real-world captured images demonstrate that the predicted footprints are almost identical to the actual responses. The same model is trained for multiple views across multiple objects such that the learned representations can be used to generalize to unseen sub-surface scattering materials as well.