Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
To resolve the photometric mismatch inherent to virtual asset insertion without task-specific training, the authors devise Ad-Relight, an inference-time framework that transfers ambient scene illumination onto synthetic graphics using a pretrained diffusion prior. The method circumvents generative distortion by isolating scene illumination through differential background probing, combining this residual with intrinsic graphic-shade decomposition and soft attenuation masking. Across 560 benchmark placements, the approach achieves superior structural similarity, perceptual fidelity, and human preference over direct diffusion relighting, particularly on non-uniformly shaded floor surfaces.
Probing a frozen diffusion relighter with paired background queries extracts complex scene shadows and ambient lighting directly onto synthetic inserts, bypassing the need for banner-specific retraining.
Replacing a visible advertisement in a broadcast frame is geometrically straightforward but photometrically delicate. A pasted graphic can have the correct perspective and still appear detached when its brightness, shading, or shadow disagrees with the surface beneath it. This paper presents Ad-Relight, an inference-only procedure for transferring scene illumination to a supplied advertising graphic without collecting a banner-specific training set. The procedure first separates slowly varying shade from graphic structure, then probes a pretrained diffusion relighter with two nearly identical backgrounds to isolate the contribution of the target region. A final pass combines this residual with a smoothed luminance field and a soft attenuation mask. Across 560 generated placements, the approach improves structural similarity, perceptual distance, and illumination agreement over geometric compositing and direct relighting baselines. Human judgments and an automated preference study show the clearest gains on floor-mounted graphics with nonuniform lighting. The current study is image based; temporal stabilization remains an open extension.