Search papers, labs, and topics across Lattice.
This study investigates the conditions under which high-classifier-free guidance (CFG) diffusion inversion fails during image editing, focusing on the interactions between prompts and latents. By conducting a controlled generation-inversion-reconstruction experiment, the authors categorize prompts into easy, hard, and intermediate types based on their reconstruction success rates and define a new metric, prompt pressure, to assess the influence of CFG on denoising updates. The findings reveal that while total prompt pressure correlates with reconstruction quality, it does not fully account for the complexities of intermediate prompt-latent pairings, highlighting the need for a locally aware approach to improve inversion outcomes.
High-CFG diffusion inversion can fail dramatically depending on the prompt-latent pairing, revealing a nuanced landscape of reconstruction success that challenges existing assumptions.
Text-guided diffusion inversion is central to image editing, where an image is mapped to an initial latent and then edited by replaying the denoising process under a modified prompt. In practice, however, inversion is often performed with a lower classifier-free guidance(CFG) scale than the one used for generation or editing. This mismatch is empirically useful but leaves a basic question unresolved: when a target image is generated by a high-CFG trajectory, when can that trajectory actually be inverted? We study this question in a controlled generation--inversion--reconstruction setting, where the true initial latent and denoising trajectory are known. Using prompts taken from an existing diffusion-editing benchmark, we generate images under high CFG and reconstruct them with fixed-point inversion using the same prompt and guidance setting. The results reveal three types of prompt-level reconstruction behavior: easy prompts that reconstruct for most initial latents, hard prompts that fail for most initial latents, and intermediate prompts whose success depends on the prompt--latent pairing. To analyze the generation side, we define prompt pressure, a step-wise measure of how strongly CFG moves the denoising update away from the unconditional trajectory. Total pressure correlates with reconstruction quality and separates easy from hard prompts, but it does not explain the success or failure of intermediate prompt--latent pairs. Text-side analyses further show that the main visual subject and wording can change inversion difficulty. Finally, we evaluate a compact trajectory-consistency intervention that relaxes guidance only at locally unstable inverse steps. This diagnostic check improves reconstruction and Prompt-to-Prompt editing in our controlled setting, supporting the view that high-CFG inversion failure requires local, trajectory-aware analysis.
