Search papers, labs, and topics across Lattice.
HiFi-Inpaint is introduced as a novel framework for high-fidelity reference-based inpainting, specifically designed for generating human-product images with preserved product details. The framework incorporates Shared Enhancement Attention (SEA) to refine product features and a Detail-Aware Loss (DAL) function that enforces pixel-level supervision using high-frequency maps. The method is trained on a newly constructed dataset, HP-Image-40K, and achieves state-of-the-art performance in generating detail-preserving human-product images.
Achieve SOTA detail-preserving human-product image generation by using a new attention mechanism and loss function, trained on a new large-scale dataset.
Human-product images, which showcase the integration of humans and products, play a vital role in advertising, e-commerce, and digital marketing. The essential challenge of generating such images lies in ensuring the high-fidelity preservation of product details. Among existing paradigms, reference-based inpainting offers a targeted solution by leveraging product reference images to guide the inpainting process. However, limitations remain in three key aspects: the lack of diverse large-scale training data, the struggle of current models to focus on product detail preservation, and the inability of coarse supervision for achieving precise guidance. To address these issues, we propose HiFi-Inpaint, a novel high-fidelity reference-based inpainting framework tailored for generating human-product images. HiFi-Inpaint introduces Shared Enhancement Attention (SEA) to refine fine-grained product features and Detail-Aware Loss (DAL) to enforce precise pixel-level supervision using high-frequency maps. Additionally, we construct a new dataset, HP-Image-40K, with samples curated from self-synthesis data and processed with automatic filtering. Experimental results show that HiFi-Inpaint achieves state-of-the-art performance, delivering detail-preserving human-product images.
