Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a matrix-based differentiable logic programming approach to address shortcut reasoning in neurosymbolic systems, specifically targeting constraint satisfaction and cognition shortcuts. By employing a unified matrix encoding for rules and constraints, the authors demonstrate that their method significantly reduces shortcut behaviors in empirical tests on MNIST variants. Key findings reveal that one-to-one grounding of neural outputs to logical atoms outperforms traditional methods that utilize soft probability distributions, highlighting the importance of architectural choices in integrating symbolic knowledge with neural learning.
Grounding neural outputs to logical atoms can drastically reduce reasoning shortcuts in neurosymbolic systems, outperforming conventional soft probability methods.
Neurosymbolic (NeSy) systems integrate neural networks with logical reasoning to achieve both generalization and interpretability, but recent work has shown they are susceptible to shortcut reasoning behaviors. We propose a novel method using matrix-based differentiable logic programming to mitigate reasoning shortcuts in two phenomena: constraint satisfaction shortcuts, where constraints are satisfied without achieving the intended task, and cognition shortcuts, where biased data leads to semantically incorrect concept mappings despite logically sound inference. Building on recent matrix-based logic programming semantics, we introduce design elements to mitigate shortcuts, including a unified encoding of rules and constraints in a single matrix. We also identify connections to fuzzy logic t-norms and empirically compare their gradient flow properties. Through carefully designed experiments on MNIST variants, we show that one-to-one grounding of neural outputs to logical atoms significantly reduces both shortcut types compared to previous methods that rely on soft probability distributions. We then confirm that architectural choices in coupling symbolic knowledge with neural learning play a critical role in shortcut mitigation.