Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces two neural network architectures, DeepKENN and ODE-KENN, to learn approximations of the Wasserstein-2 distance, a computational bottleneck in data analysis. DeepKENN aggregates distances across CNN feature maps, while ODE-KENN uses a Neural ODE to embed inputs into a function space. Experiments on MNIST demonstrate that ODE-KENN achieves significantly lower test MSE compared to baselines and DeepKENN, offering a faster surrogate for expensive Wasserstein distance computations.
Neural ODEs can learn a 28% more accurate and faster approximation of the Wasserstein-2 distance than standard neural networks.
Computing pairwise Wasserstein distances is a fundamental bottleneck in data analysis pipelines. Motivated by the classical Kuratowski embedding theorem, we propose two neural architectures for learning to approximate the Wasserstein-2 distance ($W_2$) from data. The first, DeepKENN, aggregates distances across all intermediate feature maps of a CNN using learnable positive weights. The second, ODE-KENN, replaces the discrete layer stack with a Neural ODE, embedding each input into the infinite-dimensional Banach space $C^1([0,1], \mathbb{R}^d)$ and providing implicit regularization via trajectory smoothness. Experiments on MNIST with exact precomputed $W_2$ distances show that ODE-KENN achieves a 28% lower test MSE than the single-layer baseline and 18% lower than DeepKENN under matched parameter counts, while exhibiting a smaller generalization gap. The resulting fast surrogate can replace the expensive $W_2$ oracle in downstream pairwise distance computations.