Search papers, labs, and topics across Lattice.
This paper introduces PRISM, a novel approach to single-image reflection removal (SIRR) that leverages pretrained VAE latent spaces for improved layer decomposition. By reformulating SIRR as a latent linear separation problem and employing a Latent Composition Consistency strategy, PRISM effectively disentangles transmission and reflection layers in a single forward pass. Experimental results across six benchmarks show that PRISM significantly outperforms existing methods, demonstrating robust generalization to diverse, real-world images.
PRISM achieves superior reflection removal by utilizing latent spaces, outperforming state-of-the-art methods and enabling effective generalization to in-the-wild scenarios.
Single-image reflection removal (SIRR) seeks to recover the transmission layer from a mixture corrupted by reflections -- a severely ill-posed problem. Existing methods operate in pixel space, where the nonlinear sRGB formation model entangles the two layers and limits generalization. We observe that pretrained VAE latent spaces exhibit substantially lower coherence between image layers compared to pixel space, providing a more favorable working space for decomposition. Building on this finding, we propose \textbf{PRISM} (Pretrained-latent Reflection Image Separation Model), which reinterprets SIRR as a latent linear separation problem. Under an approximate additive formulation in latent space, PRISM learns a flow matching velocity field on a pretrained FLUX backbone that recovers both transmission and reflection in a single forward pass. To enforce robust disentanglement, we introduce a Latent Composition Consistency (LCC) strategy that constructs synthetic mixtures by swapping reflection latents across samples and enforces consistent decomposition via a cycle loss. We further propose a Layer Contrastive Separation (LCS) loss that promotes semantic separation between layers through patch-level contrastive learning, without requiring explicit reflection targets. Experiments on six benchmarks demonstrate that PRISM consistently outperforms state-of-the-art methods by significant margins, with strong generalization to in-the-wild images.
