Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces γILP, a differentiable framework for learning first-order logic rules directly from images, addressing the challenge of inductive rule learning from visual data without image labels. γILP integrates image constant substitution with rule structure induction, enabling predicate invention and end-to-end training. Experiments show γILP achieves strong performance on symbolic, relational image, and pure image datasets, demonstrating its ability to learn rules from visual data.
Skip the symbolic bottleneck: γILP learns first-order logic rules directly from images, even inventing predicates along the way.
Learning rules plays a crucial role in deep learning, particularly in explainable artificial intelligence and enhancing the reasoning capabilities of large language models. While existing rule learning methods are primarily designed for symbolic data, learning rules from image data without supporting image labels and automatically inventing predicates remains a challenge. In this paper, we tackle these inductive rule learning problems from images with a framework called {\gamma}ILP, which provides a fully differentiable pipeline from image constant substitution to rule structure induction. Extensive experiments demonstrate that {\gamma}ILP achieves strong performance not only on classical symbolic relational datasets but also on relational image data and pure image datasets, such as Kandinsky patterns.