Search papers, labs, and topics across Lattice.
This paper establishes a novel connection between binarized neural networks (BNNs) and Sugeno integrals, enabling a precise representation of input importance and interactions through a set of if-then rules. By reformulating the activation threshold test for hidden BNN neurons as a Sugeno integral on binary inputs, the authors provide an explicit set-function representation for neuron decisions and the last-layer score. This framework not only clarifies the decision-making process in BNNs but also opens avenues for richer input interactions beyond binary constraints.
Binarized neural networks can be understood through the lens of Sugeno integrals, revealing a structured way to interpret neuron decisions and input interactions.
In this article, we establish a precise connection between binarized neural networks (BNNs) and Sugeno integrals. The advantage of the Sugeno integral is that it provides a framework for representing the importance of inputs and their interactions, while being equivalent to a set of if-then rules. For a hidden BNN neuron at inference time, we show that the activation threshold test can be written as a Sugeno integral on binary inputs. This yields an explicit set-function representation of each neuron decision, and an associated rule-based representation. We also provide a Sugeno-integral expression for the last-layer score. Finally, we discuss how the same framework can be adapted to support richer input interactions and how it can be extended beyond the binary case induced by binarized neural networks.
