Search papers, labs, and topics across Lattice.
This paper introduces Parallax Portrait Matting, a two-frame matting method that leverages slight viewpoint changes between images to improve matting accuracy in challenging scenarios with richly textured foregrounds and backgrounds. By utilizing parallax effects from burst photography, the approach effectively estimates trimaps and compensates for motion estimation errors through a novel fusion of aligned views. Experimental results demonstrate that this method significantly enhances detail recovery and color accuracy compared to existing single-image matting techniques.
Achieving superior matting results by harnessing parallax from two slightly shifted images could redefine standards for portrait image processing.
Image matting is highly ill-posed, especially when both the foreground and background are richly textured. While single-image matting methods learn strong priors from data, they often struggle on these challenging cases. Existing approaches improve results by requiring additional signals such as green screens, polarized lighting, or clean background images, but these typically rely on specialized capture setups. We present Parallax Portrait Matting, a practical two-frame matting method that uses a second image captured with slight viewpoint change. Such a setting arises naturally in burst photography, where small camera motion induces foreground-background parallax and provides complementary observations for matting. Our pipeline estimates trimaps and foreground/background motion, then constructs aligned views for prediction. To handle imperfect motion estimation, the network uses the background-aligned pair for direct fusion and the foreground-aligned cue through cross-attention for error compensation. Experiments show that our method recovers finer details and more accurate foreground colors than strong single-image matting baselines on challenging portrait cases.
