Search papers, labs, and topics across Lattice.
The paper introduces NUMINA, a training-free framework to improve the numerical accuracy of text-to-video diffusion models. NUMINA identifies inconsistencies between the text prompt and the generated layout by selecting discriminative attention heads to derive a countable latent layout, which is then refined and used to modulate cross-attention. Experiments on CountBench show NUMINA improves counting accuracy by up to 7.4% on a 1.3B model and around 5% on larger 5B and 14B models, while also improving CLIP alignment and maintaining temporal consistency.
Text-to-video diffusion models can now count (more accurately) without retraining, thanks to a clever attention-based guidance method.
Text-to-video diffusion models have enabled open-ended video synthesis, but often struggle with generating the correct number of objects specified in a prompt. We introduce NUMINA , a training-free identify-then-guide framework for improved numerical alignment. NUMINA identifies prompt-layout inconsistencies by selecting discriminative self- and cross-attention heads to derive a countable latent layout. It then refines this layout conservatively and modulates cross-attention to guide regeneration. On the introduced CountBench, NUMINA improves counting accuracy by up to 7.4% on Wan2.1-1.3B, and by 4.9% and 5.5% on 5B and 14B models, respectively. Furthermore, CLIP alignment is improved while maintaining temporal consistency. These results demonstrate that structural guidance complements seed search and prompt enhancement, offering a practical path toward count-accurate text-to-video diffusion. The code is available at https://github.com/H-EmbodVis/NUMINA.
