Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper establishes a lower bound on the minimal width of deep neural networks required to approximate any continuous function from $\mathbb{R}^n$ to $\mathbb{R}^m$ under uniform convergence on compact sets. The minimal width is shown to be at least $n+\min\{n,m\}$ when $\mathbb{RP}^{n-1}$ admits a smooth immersion into $\mathbb{R}^n$ and the activation function is continuous and monotone. For ReLU networks, this implies a minimal width of $n+m$ when $n \in \{2, 3, 4, 7, 8\}$ and $1 \le m \le n$, revealing a link between neural network approximation theory and differential topology.
The minimal width of ReLU networks for approximating functions from $\mathbb{R}^n$ to $\mathbb{R}^m$ is $n+m$ for specific $n$ values, directly linking network capacity to the topological properties of real projective space.
We investigate the minimal width of deep neural networks that can approximate all continuous functions from $\mathbb{R}^n$ to $\mathbb{R}^m$ in the topology of uniform convergence on compact subsets. We show that whenever the real projective space $\mathbb{RP}^{n-1}$ admits a smooth immersion into $\mathbb{R}^n$, the minimal width is at least $n+\min\{n,m\}$, assuming that the activation function is continuous and monotone. As a consequence, the minimal width of ReLU networks is $n+m$ whenever $n$ is equal to 2, 3, 4, 7 or 8 and $1\le m \le n$, extending results of Hanin-Sellke and Hwang. This suggests an intriguing connection between the approximation theory of neural networks and differential topology.