Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Pose-ICL, a novel framework that employs 3D-aware In-Context Learning to enhance pose control in subject customization for image generation. By utilizing Surface-Anchored Position Embedding (SAPE), the method anchors image tokens to the surface coordinates of a volumetric bounding box, allowing for more accurate pose representation and identity consistency across different poses. Extensive evaluations reveal that Pose-ICL outperforms existing techniques, addressing critical limitations in pose accuracy and cross-pose appearance consistency.
Achieving unprecedented pose accuracy and identity consistency in image generation, Pose-ICL transforms how we customize subjects in 3D-aware settings.
Subject Customization is a foundational task in modern image generation. By providing a few reference images and a text prompt, users can generate images of a specific object in any desired scene. However, existing methods still struggle to achieve effective pose control for customized subjects. In practice, they often exhibit inaccurate poses or inconsistent cross-pose appearances. These limitations suggest that understanding objects in a volumetric manner remains a significant challenge for 2D-native backbones. To address this challenge, we propose Pose-ICL, a tuning-free framework that leverages 3D-aware In-Context Learning (ICL) to directly adapt to new subjects through multiple paired image-pose references. Its core mechanism,Surface-Anchored Position Embedding (SAPE), equips the model with explicit 3D awareness by anchoring image tokens to the surface coordinates of a volumetric bounding box. Dedicated refinements ensure its seamless compatibility with existing DiT models. Extensive evaluations on both 3D assets and real-world subjects demonstrate that Pose-ICL significantly outperforms current methods in both pose accuracy and identity consistency.