Search papers, labs, and topics across Lattice.
To resolve pervasive structural hallucinations where MLLMs confuse camera-centric perspectives with intrinsic human coordinates, the authors introduce the SPACE benchmark alongside a targeted spatial data construction and alignment pipeline. Standard vision-language models consistently fail at basic subject-centered laterality and anatomical-object bindings, creating major downstream bottlenecks for human video generation, avatar synthesis, and fine-grained action understanding. By coupling fine-grained body-part localization hints for synthetic caption rewriting with rubric-based GRPO alignment that explicitly penalizes spatial inversions, their open-source pipeline dramatically reduces spatial hallucination rates to compete with proprietary frontier models.
Even top-tier vision-language models consistently invert a subject's left and right, exposing a blind spot in camera- versus subject-centric spatial reasoning that rubric-guided GRPO over anatomical priors can finally resolve.
While multimodal large language models (MLLMs) achieve remarkable performance on generic image captioning, they frequently suffer from structural hallucinations in human-centric scenarios. Accurately modeling human subjects is foundational for critical downstream applications, such as accurate avatar/video/image generation and fine-grained human action understanding. However, these tasks require highly precise subject-centered spatial grounding, such as distinguishing egocentric left/right laterality and maintaining correct anatomical-object bindings. Although catastrophic for structural integrity, these localized spatial inversions are often overshadowed by overall descriptive metrics in existing benchmarks. To systematically expose and quantify this bottleneck, we introduce SPACE (Subject-centric Poses, Appearance, and Characteristics Evaluation), a benchmark designed to evaluate subject-centered spatial understanding. On SPACE, we reveal that despite strong generic perception, current MLLMs consistently fail to ground descriptions in the subject's intrinsic frame of reference. To bridge this gap, we propose a specialized data construction and alignment pipeline. We first extract structured spatial hints from fine-grained body-part localization to guide a two-stage caption rewriting process, yielding highly spatially-faithful training data. Furthermore, we design a rubric-based reward for Group Relative Policy Optimization (GRPO) that explicitly penalizes structurally critical spatial errors during alignment. Extensive experiments on SPACE demonstrate our framework significantly improves human-centric caption quality, particularly in subject-centered spatial reasoning, achieving performance competitive with strong closed-source models. Our benchmark and code are available at https://github.com/JHang2020/SPACE-Eval.
