Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
Generative Grounding Feedback (GGF) couples visual understanding and generation in unified multimodal models through a self-evolving post-training framework driven solely by text prompts and self-generated visual "dreams." The approach uses flow-level latent feedback to transfer image-grounded trajectory directions into text-conditioned flow matching, alongside a dream replay mechanism that enforces claim-level perceptual consistency across re-imagined captions. Across diverse unified architectures, GGF consistently boosts text-to-image generation alignment while delivering simultaneous, unsupervised gains in visual understanding without requiring external paired image-text data.
Unified multimodal models can bootstrap both visual generation and perceptual understanding purely from text prompts by treating their own generative flow trajectories as self-supervised grounding signals.
Unified multimodal models integrate visual understanding and generation within a single network, yet the two capabilities are commonly optimized as separate tasks. We introduce Generative Grounding Feedback(GGF), a self-evolving post-training framework that uses only text prompts and the model's own visual experience. Given a prompt, the model first generates a visual ``dream.'' Flow-level feedback compares text-, image-, and repair-conditioned predictions at the same noisy latent state, transferring image-grounded generation directions to the prompt condition. Dream replay grounding replays this dream through captioning and re-imagination, training claim-level evidence to remain consistent across the replay while separating unrelated visual experiences. Jointly optimized, these two directions let generation provide visual grounding for understanding and understanding refine subsequent generation without paired image--text supervision. Experiments across unified models with different understanding--generation integration designs show consistent improvements in text-to-image generation together with modest gains in visual understanding.