Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
This paper addresses the challenge of generating coherent visual stories with diffusion models by proposing EOS-Story, a framework that balances identity preservation with scene-specific adaptation. EOS-Story decouples narrative prompts into identity and scene sub-prompts and introduces Cross-Contextual Bridging to inject appearance cues into scene embeddings, while Adaptive Identity Preservation mitigates structural artifacts caused by scale mismatches in the visual domain. Experiments on an extended Consistory+ benchmark demonstrate competitive or superior performance in generating semantically aligned and structurally flexible image sequences.
Diffusion models can now generate visually coherent stories by explicitly disentangling identity and scene information and bridging appearance gaps with a novel <EOS> embedding injection.
Recent advancements in diffusion models have significantly improved text-to-image generation, enabling their application to visual storytelling, where coherent image sequences are generated from narrative prompts. However, existing methods primarily focus on identity preservation and often fail to adapt to diverse scene variations, resulting in semantic misalignment and structural inflexibility. We propose EOS-Story, a training-free framework that harmonizes identity consistency with scene-specific adaptation across text and vision spaces. In the text space, we decouple the narrative into identity and scene sub-prompts to prevent information dilution, but this leaves the scene without access to appearance cues. To bridge this gap, we introduce Cross-Contextual Bridging, which softly injects a phrase-level appearance residual into the scene's <EOS> embedding. In the vision space, we find that scale mismatch between identity and scene subjects causes a few identity tokens to be repeatedly transferred, producing structural artifacts. We address this with Adaptive Identity Preservation, which anchors identity features at the scene-specific scale (Identity Anchoring) and integrates them via Identity-Aware Self-Attention. To evaluate performance under varied spatial compositions, we extend the Consistory+ benchmark with diverse framing scenarios (Consistory+_+). Extensive experiments show that EOS-Story achieves competitive or superior performance on both benchmarks.