Search papers, labs, and topics across Lattice.
This paper introduces Neuro-Relational Programs (NRPs), a novel declarative query language that integrates numeric vector embeddings with relational databases, allowing for the joint processing of embeddings and relational content. By extending Datalog-style rules with operations for combining and transforming embeddings, NRPs create a unified framework that merges relational reasoning with learnable neural components. The authors demonstrate that NRPs can represent both query plans and neural architectures, establishing their expressive power in relation to existing computational models and frameworks.
NRPs redefine the landscape of relational database queries by seamlessly integrating neural computation, allowing for both relational reasoning and learnable components in a single framework.
The conventional approach to deep learning over relational databases applies neural models, such as Graph Neural Networks (GNNs), to a graph representation of the database. Recent approaches instead operate on databases directly, associating tuples with embeddings and extending query mechanisms to jointly process embeddings and relational content. Inspired by these developments, we introduce Neuro-Relational Programs (NRPs), a declarative query language for relational databases whose facts carry numeric vector embeddings. NRPs extend Datalog-style rules with operations that combine, aggregate, and transform embeddings, thereby interleaving relational reasoning and learnable neural components within a single formalism. This yields a general approach to neural computation over relational data: an NRP can be read both as a query plan with trainable components and as a neural architecture with relational structure built in. Natural syntactic fragments of NRPs recover existing architectures and query formalisms. Zero-ary NRPs correspond to non-adaptive query algorithms; monadic NRPs generalize GNN-style message passing and precisely capture Deep Homomorphism Networks, a connection that we extend to frontier-guarded NRPs over databases with row-ids. We characterize the expressive power of unrestricted NRPs with ReLU-FFN transformations by FOCQ, an extension of first-order logic with counting interpreted over real-weighted structures, yielding a precise connection with uniform TC$^0$ over ordered databases. Together, these results establish NRPs as a broad declarative framework for querying and neural computation over relational data.