Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a neurosymbolic framework that leverages Combinatory Categorial Grammar (CCG) to transform outputs from large language models (LLMs) into typed compositional derivations. By aligning the prefix-driven generation of LLMs with CCG's incremental processing model, the authors demonstrate that LLM outputs can be reconstructed in a principled manner, allowing for enhanced structural and content validation. The framework not only applies to natural language but also extends to formal languages, enabling a dual-layer checking system that mitigates hallucinations and structural failures in generated content.
LLM outputs can be transformed into compositional derivations, enabling robust validation against structural failures and hallucinated content.
Large language models (LLMs) generate fluent text by incrementally predicting the next token from a prefix. Critics in the generative tradition argue that such systems lack genuine grammar; influential replies from the dependency-grammar perspective hold that LLM behavior is well described by local head-dependent structure built word by word. We argue that a sharper observation has been overlooked: the prefix-driven, type-completing dynamics of autoregressive generation align closely with the incremental processing model that Combinatory Categorial Grammar (CCG) was originally designed to support. On this basis we propose a neurosymbolic framework in which LLM outputs are lifted into typed compositional derivations -- not claiming that LLMs implement CCG internally, but that their outputs admit a principled, incremental, and auditable CCG reconstruction. Two consequences follow. First, through the Curry-Howard correspondence the lifting extends beyond natural language to the formal languages LLMs also produce -- programming languages such as Solidity, description-logic and query languages such as OWL and SQL -- with the type system varying and the architecture held fixed. Second, the lifting supports two layers of checking: a compositional layer that catches structural failures directly, and a content layer that checks the lifted structure against external knowledge sources, enabling the earliest possible flagging of hallucinated content. The account thereby requires of a producer not cognition but a prefix-driven generative profile. We close with a sketch of synchronous LLM-CCG coupling as one direction the framework opens.