Search papers, labs, and topics across Lattice.
NUSCASPeng Cheng LaboratoryState Key Laboratory of Communication Content CognitionAug 4, 2026arXiv:2608.03471This paper introduces Hi-Token, a novel hierarchical coordinate tokenization method that enhances the representation of bounding-box coordinates in generative vision-language models by encoding each coordinate with axis-specific tokens for different digit places. The authors demonstrate that this structured approach significantly improves localization accuracy across various intersection-over-union (IoU) thresholds and reduces low-overlap predictions when combined with the Hi-GAR reward mechanism during training. Experiments across multiple VLM architectures and datasets reveal that Hi-Token consistently outperforms existing methods, achieving superior performance metrics compared to strong specialist baselines.
Hierarchical tokenization transforms bounding-box representation, leading to substantial improvements in localization accuracy and model performance across various benchmarks.
Generative Vision-Language Models (VLMs) commonly treat bounding-box coordinates as independent output symbols, leaving numerical order and axis semantics implicit. We identify this representation as an important source of error in visual grounding. Hi-Token encodes each coordinate with axis-specific tokens for the hundreds, tens, and ones digits, which adds coarse-to-fine structure and increases token reuse while retaining the existing VLM architecture. Hi-GAR complements this representation with a geometry-based reward for Group Relative Policy Optimization (GRPO), using box overlap and coordinate accuracy at multiple scales. Controlled comparisons under matched training conditions show that Hi-Token improves localization throughout the evaluated IoU range. Hi-GAR further reduces low-overlap predictions and is used only during training. Experiments on three VLM backbones and the RefCOCO family show consistent gains across models and benchmarks. Hi-R1 achieves higher values than strong specialist baselines on most reported metrics. Analyses of token frequency, digit boundaries, object scale, and IoU distributions explain the effects of coordinate representation and reward training. The results show that structured coordinate generation provides an effective approach to generative visual grounding.
