Search papers, labs, and topics across Lattice.
This paper enhances Neural Markov Logic Networks (NMLNs) by integrating graph neural networks to boost the expressive capacity of their potential functions and introducing a novel training and inference algorithm called parallel noising, inspired by parallel-tempering Markov chain Monte Carlo methods. These improvements enable NMLNs to outperform diffusion-based generative graph models on larger structures while also achieving competitive performance with specialized text-based recurrent models for small molecular structures. The findings underscore the potential of NMLNs in advancing generative modeling in complex relational domains.
NMLNs can now outperform diffusion-based models on large graphs, thanks to a novel parallel noising algorithm and enhanced expressive capacity.
Neural Markov Logic Networks (NMLNs) are a flexible neurosymbolic relational model. Previous work has shown that, although NMLNs achieve strong performance as generative models for small relational structures, they underperform diffusion-based generative graph models on larger structures. In this paper, we strengthen NMLNs along two main dimensions: (i) we increase the expressive capacity of their potential functions using graph neural networks, and (ii) we develop a new training and inference algorithm inspired by parallel-tempering Markov chain Monte Carlo methods, which we name parallel noising. Together, these enhancements enable NMLNs to attain strong performance in graph generation relative to general diffusion-based generative graph models. Furthermore, they allow NMLNs to match the performance of specialized text-based recurrent models when generating small molecular structures.
