Search papers, labs, and topics across Lattice.
This paper introduces the concept of "neural echoes," a novel framework that leverages signal processing principles to elucidate the behavior of neural networks through local, space-adaptive impulse responses and filter kernels. By visualizing these echoes, researchers can gain insights into the dynamics of various network architectures, including convolutional and transformer models, without requiring differentiability. The findings reveal that neural echoes can effectively replicate classical denoising techniques, such as bilateral filtering, thereby bridging traditional signal processing with contemporary explainable AI methods.
Neural echoes reveal how neural networks can mimic classical denoising techniques, offering a fresh lens for understanding their inner workings.
We introduce the neural echo as a tool for understanding the behavior of neural networks. It generalizes the model-based concepts of impulse responses, diffusion echoes, and filter echoes to learning-based methods. It provides local, space-adaptive impulse responses and filter kernels for a neural network, its so-called echoes. These echoes depend on the input image and can be visualized to understand the learned dynamics of the network via an affine mapping. Neural echoes build a bridge from classical signal processing to modern explainable AI. They are very general and can be applied to both image-to-image and classification networks, with convolutional or fully connected structure, of feedforward or recurrent type, including modern transformer networks. Network differentiability is not required. In the differentiable case, neural echoes comprise concepts based on the network Jacobian, such as saliency maps and the analysis of adversarial perturbations, as special instances. As a simple blueprint to explain our framework, we derive neural echoes for the denoising convolutional neural network (DnCNN). Our experiments suggest that this network weights pixels based on their spatial and gray value distances. This not only clarifies its behavior, but also shows that it can reproduce key concepts of classical model-based denoisers such as bilateral filtering.
