Tosho Hirasawa

Reducing the modality gap in CLIP can paradoxically lead to worse accuracy by concentrating predictions on fewer classes, a phenomenon termed prediction-level hubness.

Hallucination detectors often mistake the beginning of a caption for truth, regardless of its actual accuracy, revealing a critical blind spot in VLM evaluation.