Search papers, labs, and topics across Lattice.
This paper explores the philosophical implications of representation in machine learning, particularly in light of the convergence of representational properties across various AI models. By engaging with debates in the philosophy of mind, the authors critique the Platonic Representation Hypothesis, which posits that this convergence stems from a unified structure of reality. The findings highlight the limitations of relying solely on alignment evidence to draw strong metaphysical conclusions, while also proposing new avenues for future research in this domain.
The convergence of representational properties in AI models may not stem from a shared reality, challenging the foundations of the Platonic Representation Hypothesis.
Representation is a central concept in modern machine learning, where it usually refers to internal encodings that support learning and generalization. As models scale and their capabilities become increasingly human-level, this representational language sometimes shifts from an engineering context into the more philosophically loaded domain of mental representation. We argue that this is the case for recent claims about the convergence of representational properties across different AI models. In particular, we assess the arguments developed in The Platonic Representation Hypothesis, according to which this convergence is driven by a unified structure of reality. We examine this claim by introducing arguments and ideas from debates about mental representation in the philosophy of mind. We argue that these philosophical resources can clarify what is at stake in such claims, explain why alignment evidence alone is insufficient for strong metaphysical conclusions, and suggest directions for future research.