Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper critiques the implicit representation of concepts in large language models (LLMs) and advocates for a paradigm shift towards designing explicit, structured conceptual frameworks within these models. By mapping the design space along the dimensions of pipeline stage and internal versus external grounding, the authors identify underexplored areas and highlight the need for a cohesive approach to integrating concept-level structure throughout the model's lifecycle. The key finding reveals that while externally grounded methods are prevalent, there is significant potential in enhancing inference-time approaches to improve stability and controllability of concepts in LLMs.
Designing LLMs with explicit conceptual representations could unlock new levels of stability and alignment with human cognition.
Large language models (LLMs) encode rich concept-like information, but represent it implicitly through distributed statistical associations rather than as explicit, structured, compositional concepts. Consequently, concept-level structure is typically \emph{found} rather than \emph{designed}: it is recovered after training through probing or dictionary learning, with no architectural guarantee of stability, compositionality, controllability, or alignment with human conceptual organization. We argue that concepts should instead be treated as a design axis for LLMs, and map the design space along two dimensions: the pipeline stage at which concept structure is introduced (training objective, core architecture, inference, or post-hoc interpretation), and whether that structure is internally derived from the model's own representations or grounded in external resources. This taxonomy reveals three broad patterns: inference-time approaches remain comparatively underexplored, related ideas have developed largely in isolation across pipeline stages, and externally grounded methods span the entire pipeline despite often being described under different terminology. Together, these observations motivate moving beyond recovering concept-like structure from trained models toward designing LLMs with explicit conceptual representations.