Search papers, labs, and topics across Lattice.
This paper introduces Light-Geometry Interaction (LGI) maps, a novel representation encoding light-aware occlusion from monocular depth maps, to capture essential light-shadow interactions without full 3D reconstruction. They propose a unified pipeline for joint shadow generation and relighting by embedding LGI into a bridge-matching generative backbone, enforcing physically consistent light-shadow reasoning. The authors curated a large-scale benchmark dataset and demonstrate significant improvements in realism and consistency across synthetic and real images compared to prior disjoint approaches.
Stop generating floating shadows and inconsistent illumination: LGI maps leverage monocular depth to capture light-geometry interactions, enabling physically consistent shadow generation and relighting.
We propose Light-Geometry Interaction (LGI) maps, a novel representation that encodes light-aware occlusion from monocular depth. Unlike ray tracing, which requires full 3D reconstruction, LGI captures essential light-shadow interactions reliably and accurately, computed from off-the-shelf 2.5D depth map predictions. LGI explicitly ties illumination direction to geometry, providing a physics-inspired prior that constrains generative models. Without such prior, these models often produce floating shadows, inconsistent illumination, and implausible shadow geometry. Building on this representation, we propose a unified pipeline for joint shadow generation and relighting - unlike prior methods that treat them as disjoint tasks - capturing the intrinsic coupling of illumination and shadowing essential for modeling indirect effects. By embedding LGI into a bridge-matching generative backbone, we reduce ambiguity and enforce physically consistent light-shadow reasoning. To enable effective training, we curated the first large-scale benchmark dataset for joint shadow and relighting, covering reflections, transparency, and complex interreflections. Experiments show significant gains in realism and consistency across synthetic and real images. LGI thus bridges geometry-inspired rendering with generative modeling, enabling efficient, physically consistent shadow generation and relighting.
