Search papers, labs, and topics across Lattice.
This paper analyzes the topological complexity of neural network superlevel sets, focusing on networks with activations satisfying a Riccati-type ODE condition. It demonstrates that such networks produce Pfaffian outputs on analytic domains, with the Pfaffian format determined solely by the network architecture. Consequently, the total Betti numbers of superlevel sets and Lie bracket rank drop loci are bounded by the architecture, independent of the network weights.
Forget about weight tuning – the inherent architecture of certain neural networks dictates fundamental limits on the topological complexity of their decision boundaries.
We show that neural networks with activations satisfying a Riccati-type ordinary differential equation condition, an assumption arising in recent universal approximation results in the uniform topology, produce Pfaffian outputs on analytic domains with format controlled only by the architecture. Consequently, superlevel sets, as well as Lie bracket rank drop loci for neural network parameterized vector fields, admit architecture-only bounds on topological complexity, in particular on total Betti numbers, uniformly over all weights.
