Search papers, labs, and topics across Lattice.
This paper introduces SoftReason, a novel neuro-soft-symbolic architecture that enables fully differentiable deductive reasoning over high-dimensional perceptual data by integrating probabilistic base facts with knowledge graph (KG) evidence. By eliminating the gradient gap typically present in classical neuro-symbolic systems, SoftReason allows for a continuous flow of information between perception and deduction, facilitating the representation of deductive states as soft interpretation tensors. The architecture is instantiated in the context of Knowledge-aware Visual Question Answering (KVQA), showcasing its ability to perform end-to-end perceptual grounding and differentiable reasoning in a unified framework.
SoftReason achieves seamless integration of high-dimensional perception and symbolic reasoning, enabling end-to-end differentiable learning in complex reasoning tasks.
In many reasoning problems, the premises are not observed as discrete symbols, but must be inferred from high-dimensional inputs. Further, the predicate vocabulary, argument structure, and trusted evidence are supplied by a Knowledge Graph (KG), or rule definitions. Classical neuro-symbolic pipelines have a discrete interface between perception and deduction. We present a neuro-soft-symbolic architecture for differentiable deductive reasoning over latent perceptual facts and knowledge-provided predicates. SoftReason removes the gradient gap by representing the deductive state as a local soft interpretation tensor over candidate constants and predicates. Perception proposes probabilistic base facts, KG triples enter as high-confidence soft evidence, and every query anchor, predicate choice, and closure update remains differentiable. Our core innovation is a learned differentiable lift of the immediate-consequence operator. It uses predicate-definition embeddings and latent composition channels to form soft body-predicate mixtures, aggregate over all possible witnesses, propose query-conditioned head facts, and update the interpretation through a monotone probabilistic OR. We instantiate the framework on Knowledge-aware Visual Question Answering (KVQA), and demonstrates how SoftReason supports end-to-end perceptual grounding, KG evidence injection, and differentiable deductive closure in one trainable architecture.
