Search papers, labs, and topics across Lattice.
ABACUS is a unified vision-language model that integrates object counting, crowd counting, referring-expression counting, and count-faithful image generation without requiring benchmark-specific training. It employs three innovative techniques: density-aware adaptive zooming for spatial grounding, a boundary-aware count policy to mitigate crop-boundary errors, and a cycle-consistent self-critique mechanism to bridge the understanding-generation gap. The model achieves state-of-the-art performance across seven benchmarks, surpassing both specialized models and larger generalist counterparts.
ABACUS outperforms specialized models and larger generalists by effectively bridging the gap between understanding and generation in vision-language tasks.
ABACUS is a unified vision-language model that handles object counting, crowd counting, referring-expression counting, and count-faithful image generation without any benchmark-specific training required. Our model is built on existing 3B-parameter unified foundation model and is adapted for object localization tasks using three key innovations: density-aware adaptive zooming with objectness maps for spatial grounding; a boundary-aware count policy via GRPO to eliminate crop-boundary errors; and a cycle-consistent GRPO strategy where the understanding branch self-critiques generated outputs, closing the understanding-generation gap without any external annotations. ABACUS achieves state-of-the-art results across seven benchmarks, outperforming both task-specific specialists and larger generalist models.
