Search papers, labs, and topics across Lattice.
This paper introduces AnyStyle, a novel framework for image-guided style transfer that utilizes a single low-rank adaptation (LoRA) to effectively merge style and content images while maintaining structural integrity. By leveraging training-free structural guidance derived from the content image's internal attention, AnyStyle outperforms traditional methods that rely on multiple adapters, which often lead to conflicts and reduced controllability. Experimental results demonstrate that AnyStyle achieves competitive quantitative performance alongside significantly enhanced perceptual quality, marking a substantial advancement in the field of style transfer.
A single LoRA can achieve superior style transfer results by effectively integrating content and style without the conflicts of multiple adapters.
Image-guided style transfer aims to apply the artistic characteristics of a style image to a content image while preserving its semantic structure and layout. Despite advances in diffusion-based methods, existing approaches often face challenges in disentangling content and style, particularly when independently optimized adapters are naively combined, causing conflicts between adapters and limiting controllability over the content-style balance in inference. We further demonstrate that training-free structural guidance directly derived from the content image through the internal attention of pre-trained model outperforms a dedicated content LoRA adapter in terms of structural fidelity and computational efficiency. Building on these observations, we propose AnyStyle, a streamlined framework for image-guided style transfer. The framework adopts a unified single-adapter paradigm for coherent style capture from the style image and incorporates training-free structural guidance from the content image, thus avoiding complex entanglement between multiple adapters and improving controllability and stability. Extensive experiments show that our method delivers competitive quantitative performance and significantly improved perceptual quality. Code is available at https://github.com/Yvan1001/AnyStyle.
