Search papers, labs, and topics across Lattice.
This paper introduces a novel approach to mirror inpainting that leverages scene geometry to generate geometrically consistent reflections in mirrors. By estimating scene geometry and projecting visible content into the mirror, the authors reduce the need for hallucination and improve reflection consistency through a two-mask diffusion strategy. Evaluations on both synthetic and real images demonstrate that incorporating geometric constraints significantly enhances the quality of the generated reflections compared to traditional methods.
By harnessing scene geometry, this method achieves significantly improved reflection consistency in mirror inpainting, outperforming conventional generative techniques.
Mirrors are common in real-world images, yet producing geometrically consistent reflections with generative models remains challenging. Unlike most objects, mirror appearance depends on scene geometry and viewpoint, making it hard to synthesize using learned appearance priors alone. We address this in the mirror inpainting setting, where the scene is fixed and only the mirror region is generated. Our key insight is that much mirror content is geometrically constrained by the visible scene and need not be hallucinated. We estimate scene geometry and project visible content into the mirror to recover reflection regions determined by geometry. A generative model then completes the mirror region via a two-mask diffusion strategy balancing geometric constraints with the model's learned priors, reducing projection artifacts and improving reflection consistency. The method is training-free and applicable to complex real-world scenes. We evaluate on MirrorBench-V2 (synthetic) and real images. Using standard and geometry-aware metrics, we show that explicitly using scene geometry improves consistency.
