Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Lexical Consensus, a framework for investigating how artificial agents can learn and stabilize new lexical meanings from grounded experiences using visual embeddings and nonce words. The study reveals a perceptual-coherence gradient in word learning, where native categories are most easily acquired, while far-disjunctive concepts yield near-chance performance, indicating that perceptual distance is a stronger predictor of acquisition accuracy than semantic distance. Additionally, the findings highlight the distinction between naming and retrieval mechanisms, with exemplar-based methods outperforming centroid prototypes in label-to-image tasks, underscoring the complexities of lexical grounding in AI systems.
Perceptual distance, not semantic relatedness, dictates how effectively AI agents can learn new lexical meanings from visual input.
Artificial intelligence systems are commonly evaluated through task performance and behavioral imitation, but such evaluations leave open whether an artificial agent can acquire, stabilize, and use new lexical meanings from grounded experience. This paper introduces Lexical Consensus, an experimental framework for studying grounded word learning over a structured perceptual substrate. Using frozen DINOv2 visual embeddings, Carroll-style nonce words, and interpretable lexical learners plus linear baselines, we test whether agents can acquire artificial labels for visual concepts, generalize them bidirectionally, and stabilize them across controlled settings. The main result is a robust perceptual-coherence gradient: native categories are easiest to learn, coherent overextensions remain learnable, mid-range disjunctive concepts degrade, and far-disjunctive concepts approach chance. A pre-registered CIFAR-100 dissociation experiment confirms that this gradient is governed by perceptual distance rather than semantic relatedness: perceptual distance predicts acquisition accuracy (partial R^2 = 0.245, p < 1e-7), while semantic distance adds no significant explanatory power (partial R^2 = 0.002, p = 0.660). Bidirectional evaluation shows that naming and retrieval are distinct: exemplar-based mechanisms outperform centroid prototypes in label-to-image retrieval, exposing a memory-fidelity dimension separate from naming accuracy. Falsification controls, homogeneous candidate-pool evaluations, and null results on representational restructuring indicate that frozen perceptual geometry both enables lexical grounding and limits what can be acquired without representational adaptation.