Search papers, labs, and topics across Lattice.
This study reconciles conflicting findings from previous research on the ability of large vision-language models (LVLMs) to generate efficient referring expressions by controlling for task differences and comparing explicit versus implicit prompting strategies. The authors replicate the success of LVLMs in coordinating efficient communication when explicitly prompted, while revealing a significant shortcoming in their ability to infer the need for efficiency from implicit prompts. These results underscore fundamental differences in communication strategies between humans and AI systems, with implications for designing more effective interaction protocols.
LVLMs can coordinate efficient communication when explicitly prompted, but struggle to do so with implicit cues, revealing a critical gap in AI-human communication parallels.
Two recent studies (Jones et al. (2026); Zeng et al. (2026)) reach apparently contradictory conclusions about whether LVLMs can coordinate on efficient referring expressions. We control for task differences between the studies while directly comparing their prompting styles. We replicate the finding that models can coordinate efficient referring expressions when explicitly prompted to do so, suggesting that other task differences are not responsible for divergent results. However, we also find that the same models fail to infer the need for communicative efficiency from a more implicit prompt, highlighting critical differences between how humans and AI systems communicate.