Search papers, labs, and topics across Lattice.
This study investigates the phenomenon of computation in superposition within neural networks, specifically through a compressed-computation setup using a single-hidden-layer ReLU network. By training the network with an $L^4$ loss function instead of the conventional $L^2$, the authors demonstrate that the network can effectively compute multiple functions with fewer neurons than the number of functions, encoding features as sparse binary codewords. The findings reveal that a compact representation of the network's functionality can be achieved using only three scalars, significantly enhancing our understanding of neural network capabilities in superposition.
Training a neural network with $L^4$ loss enables it to compute more functions than neurons, revealing a surprising efficiency in representation.
Neural networks are thought to represent concepts as directions in their activation space, and superposition lets them encode more concepts than they have dimensions. It is natural to ask whether they can also compute more functions than they have neurons, i.e., perform computation in superposition. In this regime many functions of sparse inputs are evaluated by a layer with fewer neurons than there are functions to compute. Representation in superposition is by now fairly well understood, but computation in superposition is not, and there are few toy models of it arising through training rather than being hand designed. As a toy model of computation in superposition we study the compressed-computation setup: a single-hidden-layer ReLU network with 50 neurons that must compute the ReLU of each of 100 sparse input features. We show that training it under an $L^4$ loss (the mean fourth power of the error), rather than the usual $L^2$, elicits a solution that appears to compute all features in superposition. We then reverse-engineer this solution. We find that the network assigns each feature a sparse binary codeword over neurons and decodes it with a pseudoinverse of the encoder. Given these codewords, a description with only three scalars recovers most of the network's performance, and we validate it by building equivalent networks from hand-designed codes.
