Search papers, labs, and topics across Lattice.
This paper introduces SLiR (Shifting-based Linear Relaxations), a novel method for generating optimizable linear relaxations of activation functions in neural networks, which traditionally rely on manual crafting for each function. By utilizing only a Lipschitz constant or a set of critical points, SLiR efficiently computes sound upper and lower bounds through a shifting procedure, significantly reducing the manual effort required for verification. Experimental results demonstrate that SLiR achieves tighter relaxations and enables the verification of up to 7.8 times more properties than existing state-of-the-art techniques.
SLiR can verify 7.8x more properties than existing methods by automating the generation of linear relaxations for a diverse range of activation functions.
The use of neural networks (NNs) is rapidly increasing, including in safety- and security-critical domains. To provide formal guarantees about NN behavior, many verification methods rely on optimizable linear relaxations of activation functions. However, existing techniques depend on hand-crafted relaxations for each activation function. Extension to state-of-the-art activation functions therefore requires substantial manual effort. In contrast, our approach SLiR (Shifting-based Linear Relaxations) is broadly applicable, requiring only a Lipschitz constant or a set of critical points. SLiR parameterizes relaxations by their slope and computes the corresponding offset via a shifting procedure that ensures sound upper and lower bounds over the input domain, enabling efficient optimization while maintaining correctness. Our experiments show that SLiR produces tight relaxations across a wide range of practical activation functions and enables verification of up to 7.8x more properties compared to state-of-the-art methods.
