Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
ABACUS is a unified vision-language model that effectively integrates object counting, crowd counting, referring-expression counting, and count-faithful image generation without the need for benchmark-specific training. This model leverages a 3B-parameter foundation and introduces three key innovations: density-aware adaptive zooming for spatial grounding, a boundary-aware count policy to mitigate crop-boundary errors, and a cycle-consistent self-critique mechanism to bridge the understanding-generation gap. As a result, ABACUS achieves state-of-the-art performance across seven benchmarks, surpassing both specialized models and larger generalist alternatives.
ABACUS outperforms specialized models and larger generalists by seamlessly integrating counting and image generation without benchmark-specific training.
ABACUS is a unified vision-language model that handles object counting, crowd counting, referring-expression counting, and count-faithful image generation without any benchmark-specific training required. Our model is built on existing 3B-parameter unified foundation model and is adapted for object localization tasks using three key innovations: density-aware adaptive zooming with objectness maps for spatial grounding; a boundary-aware count policy via GRPO to eliminate crop-boundary errors; and a cycle-consistent GRPO strategy where the understanding branch self-critiques generated outputs, closing the understanding-generation gap without any external annotations. ABACUS achieves state-of-the-art results across seven benchmarks, outperforming both task-specific specialists and larger generalist models.